00000001:02000400:0.0F:1788482725.018084:0:2952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788482733.536848:0:3154:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788482734.393352:0:3213:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1315 MB/s 00000001:01000000:3.0:1788482734.643319:0:3213:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1627 MB/s 00000001:01000000:3.0:1788482734.893372:0:3213:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10247 MB/s 00000020:02000000:0.0:1788482735.176553:0:3245:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_84_g5b8c505 00000400:02000000:1.0F:1788482735.540909:0:3260:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.106@tcp [8/256/0/180] 00008000:02000000:2.0F:1788482737.929800:0:3410:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788482791.651008:0:5211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788482802.440569:0:5789:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788482802.440575:0:5789:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788482802.440785:0:5789:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e142337d 00000080:02000400:1.0:1788482802.440797:0:5789:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788482802.445824:0:5789:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788482802.445849:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788482802.446089:0:5789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d81db1b3) 00000020:00000080:2.0:1788482802.446117:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788482802.476048:0:5789:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788482802.476880:0:5789:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788482802.520764:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788482802.520804:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788482802.520825:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788482802.520876:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788482802.520914:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788482802.528161:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788482802.528179:0:5789:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788482802.528196:0:5789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad7880b 00000020:01000004:2.0:1788482802.528514:0:5789:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788482802.528523:0:5789:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788482802.528532:0:5789:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e142337d from MGS 00000020:01000004:2.0:1788482802.528538:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788482802.528556:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ff765265) 00000020:00000080:2.0:1788482802.528571:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788482802.528663:0:5789:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e142337d from MGS, refs=2 00080000:01000000:2.0:1788482802.528670:0:5789:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788482802.528677:0:5789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad78819 00000100:00100000:2.0:1788482802.528853:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788482802.529066:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788482802.529074:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788482802.530039:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788482802.530048:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788482802.532367:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788482802.532834:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788482802.532841:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788482802.533832:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788482802.533840:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788482802.538715:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788482802.538739:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788482802.541164:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482802.541171:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482802.541173:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482802.541852:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482802.541855:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482802.541857:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482802.542831:0:5789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788482802.559162:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788482802.793420:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1904 MB/s 00000001:01000000:2.0:1788482803.043537:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2347 MB/s 00000001:01000000:2.0:1788482803.293655:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 511 MB/s 00000001:01000000:2.0:1788482803.543747:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 635 MB/s 00080000:10000000:2.0:1788482803.551748:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788482803.572814:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788482803.572831:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788482803.572833:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788482803.574438:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788482803.574529:0:5789:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788482803.574606:0:5789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788482803.574880:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788482803.574907:0:5789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788482803.575517:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482803.575702:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788482803.575709:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788482803.577675:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788482803.577760:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788482803.578416:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788482803.578423:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788482803.578992:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788482803.579158:0:5789:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.106@tcp' 00000020:01000004:3.0:1788482803.579160:0:5789:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788482803.579210:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.106@tcp (typ=mgc) 00000020:00000080:3.0:1788482803.579231:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.106@tcp (0000000054b052c1) 00000020:00000080:3.0:1788482803.579274:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788482803.579410:0:5789:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dabbb750@MGC192.168.201.106@tcp: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788482803.579601:0:5789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.106@tcp-0 is initialized 00000040:01000000:3.0:1788482803.579609:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788482803.579954:0:5803:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788482803.580962:0:5804:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788482803.581043:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.106@tcp (uuid 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30) 00000020:00000080:2.0:1788482803.581068:0:5789:0:(genops.c:1385:class_connect()) connect: client 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30, cookie 0x42820277aad78827 00000100:00080000:2.0:1788482803.581166:0:5789:0:(import.c:510:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788482803.581172:0:5789:0:(import.c:624:import_select_connection()) MGC192.168.201.106@tcp: import 00000000dabbb750 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788482803.581225:0:5789:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a95f1bf1 x1875360072335488/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788482803.581280:0:5789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS 00000020:01000004:2.0:1788482803.581300:0:5789:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788482803.581323:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788482803.581338:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005c05971a) 00000020:00000080:2.0:1788482803.581353:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788482803.582241:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a95f1bf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3276:1875360072335488:0@lo:250: 00000100:00100000:0.0:1788482803.582384:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482803.583652:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072335488 00000100:00100000:3.0:1788482803.583667:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072335488 00000100:00100000:3.0:1788482803.583709:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482803.584153:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6c06cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3276:x1875360072335488:12345-0@lo:250: 00010000:00080000:3.0:1788482803.584188:0:5800:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30@0@lo t0 exp 0000000000000000 cur 120 last 0 00000020:00000080:3.0:1788482803.584228:0:5800:0:(genops.c:1385:class_connect()) connect: client 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30, cookie 0x42820277aad78835 00000100:00080000:3.0:1788482803.584919:0:5800:0:(import.c:65:import_set_state_nolock()) 000000000f297e18 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788482803.585063:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6c06cb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:3276:x1875360072335488:12345-0@lo:250: Request processed in 1342us (2677us total) trans 0 rc 0/0 00010000:00010000:1.0:1788482803.586179:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482803.590267:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482803.590409:0:3276:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788482803.590424:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.106@tcp: connect to target with instance 0 00000100:00080000:3.0:1788482803.590435:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788482803.590440:0:3276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788482803.590446:0:3276:0:(import.c:65:import_set_state_nolock()) 00000000dabbb750 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788482803.590452:0:3276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788482803.590470:0:3276:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788482803.590478:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a95f1bf1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3276:1875360072335488:0@lo:250: 00000100:00100000:3.0:1788482803.611446:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482803.611674:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788482803.611683:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788482803.618938:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788482803.623215:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788482803.632575:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788482803.636281:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788482803.640307:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788482803.641499:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788482803.641509:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788482803.643200:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788482803.643224:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788482803.725126:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482803.725499:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788482803.725509:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788482803.728001:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788482803.728020:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788482803.729928:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482803.730168:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788482803.730183:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788482803.734093:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788482803.734118:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788482803.738432:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482803.738735:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788482803.738742:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788482803.743068:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788482803.743080:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788482803.747038:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482803.748484:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788482803.748497:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788482803.755494:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788482803.755513:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788482803.811463:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482803.812360:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788482803.812370:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788482803.819481:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788482803.819504:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788482803.823234:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788482803.823284:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788482803.826107:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788482803.826147:0:5789:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788482803.826156:0:5789:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788482803.826335:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788482803.826383:0:5789:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788482803.826388:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788482803.826389:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788482803.826390:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482803.826392:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482803.826393:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482803.826394:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482803.826395:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788482803.826397:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788482803.826398:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482803.826400:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482803.826401:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482803.826402:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788482803.826404:0:5789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788482803.826407:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788482803.826408:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788482803.826409:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482803.826410:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482803.826415:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482803.826416:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482803.826417:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788482803.826418:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788482803.826419:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482803.826420:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482803.826421:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482803.826422:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788482803.826455:0:5789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788482803.826472:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000abc5a835 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072335616:0@lo:253: 00000100:00100000:3.0:1788482803.826555:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482803.826596:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c16937d going to sleep for 11 seconds 00000100:00100000:0.0:1788482803.827650:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072335616 00000100:00100000:0.0:1788482803.827664:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072335616 00000100:00100000:0.0:1788482803.827726:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482803.827734:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf1b0a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:5789:x1875360072335616:12345-0@lo:253: 20000000:01000000:0.0:1788482803.827778:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788482803.827781:0:5802:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788482803.830732:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788482803.830799:0:5802:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788482803.831063:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788482803.834168:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788482803.846573:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788482803.846581:0:5802:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788482803.846589:0:5802:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788482803.846593:0:5802:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788482803.846608:0:5802:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788482803.846935:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482803.847108:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788482803.847120:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788482803.847179:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788482803.847272:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788482803.847311:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788482803.847398:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788482803.847406:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788482803.847443:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788482803.847450:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788482803.847475:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788482803.847481:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788482803.847503:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788482803.847564:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788482803.847592:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788482803.847596:0:5802:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788482803.847606:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482803.847779:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788482803.847789:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788482803.847835:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788482803.847867:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788482803.847905:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788482803.847915:0:5802:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788482803.847977:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788482803.847985:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788482803.848026:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788482803.848062:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788482803.848098:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788482803.848109:0:5802:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788482803.848202:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788482803.848212:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788482803.848239:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788482803.848291:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788482803.848434:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788482803.848473:0:5802:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788482803.848481:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788482803.857048:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788482803.858026:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788482803.858071:0:5802:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.106@tcp for mdt 20000000:01000000:2.0:1788482803.858075:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:2.0:1788482803.858114:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788482803.858122:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788482803.858165:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788482803.858173:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:2.0:1788482803.858226:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788482803.858237:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788482803.858605:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788482803.858647:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788482803.858723:0:5802:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788482803.858727:0:5802:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788482803.858732:0:5802:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788482803.858754:0:5802:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788482803.868010:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788482803.868228:0:5802:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788482803.879838:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788482803.879897:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788482803.880001:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788482803.880022:0:5802:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788482803.880025:0:5802:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788482803.880029:0:5802:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788482803.880041:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788482803.880044:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788482803.880069:0:5802:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788482803.880070:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788482803.881295:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788482803.881678:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788482803.881711:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788482803.881728:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788482803.881737:0:5802:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788482803.881740:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788482803.882573:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788482803.882774:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788482803.882801:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788482803.882873:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1788482803.882888:0:5802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788482803.882890:0:5802:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1788482803.882897:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788482803.882922:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882946:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882957:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882961:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882965:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882969:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882973:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a72b3959 already unused, calling callback (00000000710d7972) 00010000:00010000:1.0:1788482803.882976:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882981:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882992:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.882997:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482803.883000:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a72b3959/0x42820277aad7883c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788482803.883024:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788482804.163156:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf1b0a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:5789:x1875360072335616:12345-0@lo:253: Request processed in 335410us (336588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482804.163185:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788482804.163300:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000abc5a835 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072335616:0@lo:253: 10000000:01000000:3.0:1788482804.163318:0:5789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788482804.163321:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788482804.163323:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788482804.163325:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482804.163326:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788482804.163327:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482804.163328:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482804.163329:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788482804.163331:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788482804.163332:0:5789:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788482804.163334:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482804.163336:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788482804.163427:0:5789:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e142337d from lustre-MDT0000 10000000:01000000:3.0:1788482804.163458:0:5789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788482804.163461:0:5789:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788482804.163466:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9eb920884d28 10000000:01000000:3.0:1788482804.163471:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788482804.163481:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eb920884d28 from 1 10000000:01000000:3.0:1788482804.163484:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788482804.163531:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 0000000050f7c3d0/0x42820277aad78843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.163634:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 0000000050f7c3d0/0x42820277aad78843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.163644:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 0000000050f7c3d0/0x42820277aad78843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482804.163663:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000abc5a835 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072335744:0@lo:101: 00000100:00100000:3.0:1788482804.163704:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.163820:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 000000004767c24b going to sleep for 11 seconds 00000100:00100000:0.0:1788482804.163933:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072335744 00000100:00100000:0.0:1788482804.163943:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072335744 00000100:00100000:0.0:1788482804.164029:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788482804.164040:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002312150b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:5789:x1875360072335744:12345-0@lo:101: 00010000:00010000:0.0:1788482804.164063:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482804.164082:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009bfbd7f8/0x42820277aad7884a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78843 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.164109:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009bfbd7f8/0x42820277aad7884a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78843 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.164120:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009bfbd7f8/0x42820277aad7884a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78843 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.164139:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009bfbd7f8, rc 0) 00000100:00100000:0.0:1788482804.164188:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002312150b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+6:5789:x1875360072335744:12345-0@lo:101: Request processed in 151us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482804.164195:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788482804.164287:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000abc5a835 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072335744:0@lo:101: 00010000:00010000:1.0:1788482804.164302:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 0000000050f7c3d0/0x42820277aad78843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.164310:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 0000000050f7c3d0/0x42820277aad78843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482804.164386:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ee419ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072335872:0@lo:501: 00000100:00100000:1.0:1788482804.164412:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482804.164697:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034736171 going to sleep for 11 seconds 00000100:00100000:3.0:1788482804.164733:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072335872 00000100:00100000:3.0:1788482804.164738:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072335872 00000100:00100000:3.0:1788482804.164762:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788482804.164768:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004aa6f737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+6:5789:x1875360072335872:12345-0@lo:501: 00000100:00100000:3.0:1788482804.165066:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004aa6f737 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+6:5789:x1875360072335872:12345-0@lo:501: Request processed in 297us (652us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788482804.165073:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788482804.165180:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ee419ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072335872:0@lo:501: 10000000:01000000:1.0:1788482804.165206:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788482804.165221:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 0000000050f7c3d0/0x42820277aad78843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.165229:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 0000000050f7c3d0/0x42820277aad78843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482804.165237:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eb9070c3000 10000000:01000000:1.0:1788482804.165241:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788482804.165244:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9eb9070c3000 10000000:01000000:1.0:1788482804.165246:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788482804.165273:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9eb9070c3000 from 1 10000000:01000000:1.0:1788482804.165275:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788482804.165297:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000a72b3959/0x42820277aad78851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.165315:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000a72b3959/0x42820277aad78851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.165325:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000a72b3959/0x42820277aad78851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482804.165338:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ee419ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336000:0@lo:101: 00000100:00100000:1.0:1788482804.165486:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482804.165515:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034736171 going to sleep for 11 seconds 00000100:00100000:3.0:1788482804.165649:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072336000 00000100:00100000:3.0:1788482804.165655:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072336000 00000100:00100000:3.0:1788482804.165689:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788482804.165697:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be0ce3ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+6:5789:x1875360072336000:12345-0@lo:101: 00010000:00010000:3.0:1788482804.165706:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482804.165719:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074e61e37/0x42820277aad78858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78851 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.165735:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074e61e37/0x42820277aad78858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78851 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.165743:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074e61e37/0x42820277aad78858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78851 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.165758:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074e61e37, rc 0) 00000100:00100000:3.0:1788482804.165791:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be0ce3ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+7:5789:x1875360072336000:12345-0@lo:101: Request processed in 96us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482804.165797:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788482804.165862:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ee419ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336000:0@lo:101: 00010000:00010000:1.0:1788482804.165871:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000a72b3959/0x42820277aad78851 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.165878:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000a72b3959/0x42820277aad78851 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482804.165888:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788482804.165902:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000a72b3959/0x42820277aad78851 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.165909:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000a72b3959/0x42820277aad78851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482804.165914:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788482804.165917:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788482804.165921:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9eb9070c3000 10000000:01000000:1.0:1788482804.165923:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788482804.165925:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788482804.165931:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788482804.165942:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000c3a9aa05/0x42820277aad7885f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.165948:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000c3a9aa05/0x42820277aad7885f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.165955:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000c3a9aa05/0x42820277aad7885f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482804.165964:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ee419ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336128:0@lo:101: 00000100:00100000:1.0:1788482804.165986:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482804.165999:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034736171 going to sleep for 11 seconds 00000100:00100000:0.0:1788482804.166057:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072336128 00000100:00100000:0.0:1788482804.166061:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072336128 00000100:00100000:0.0:1788482804.166079:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482804.166084:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007180c506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+7:5789:x1875360072336128:12345-0@lo:101: 00010000:00010000:0.0:1788482804.166090:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482804.166097:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000063051c8/0x42820277aad78866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad7885f expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.166108:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000063051c8/0x42820277aad78866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad7885f expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.166115:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000063051c8/0x42820277aad78866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad7885f expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.166121:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000063051c8, rc 0) 00000100:00100000:0.0:1788482804.166185:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007180c506 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+8:5789:x1875360072336128:12345-0@lo:101: Request processed in 100us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482804.166191:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788482804.166277:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ee419ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336128:0@lo:101: 00010000:00010000:1.0:1788482804.166286:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000c3a9aa05/0x42820277aad7885f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.166293:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000c3a9aa05/0x42820277aad7885f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482804.166332:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ee419ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336256:0@lo:501: 00000100:00100000:1.0:1788482804.166479:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482804.166630:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072336256 00000100:00100000:0.0:1788482804.166635:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072336256 00000100:00100000:0.0:1788482804.166653:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788482804.166657:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5070da0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+8:5789:x1875360072336256:12345-0@lo:501: 00000100:00100000:0.0:1788482804.166897:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5070da0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:5789:x1875360072336256:12345-0@lo:501: Request processed in 239us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482804.166905:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788482804.166944:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034736171 going to sleep for 11 seconds 00000100:00100000:0.0:1788482804.166958:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ee419ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336256:0@lo:501: 00000100:00100000:0.0:1788482804.167004:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000709da28f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336384:0@lo:503: 00000100:00100000:0.0:1788482804.167061:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482804.167087:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097cb38e3 going to sleep for 11 seconds 00000100:00100000:3.0:1788482804.167164:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072336384 00000100:00100000:3.0:1788482804.167169:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072336384 00000100:00100000:3.0:1788482804.167188:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788482804.167192:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013489cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:5789:x1875360072336384:12345-0@lo:503: 00000100:00100000:3.0:1788482804.167437:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013489cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:5789:x1875360072336384:12345-0@lo:503: Request processed in 244us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482804.167444:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482804.167635:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000709da28f pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336384:0@lo:503: 00000100:00100000:0.0:1788482804.168207:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000709da28f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5830:1875360072336512:0@lo:502: 00000100:00100000:0.0:1788482804.168322:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482804.168455:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffcbc53e going to sleep for 11 seconds 00000100:00100000:3.0:1788482804.168493:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072336512 00000100:00100000:3.0:1788482804.168498:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072336512 00000100:00100000:3.0:1788482804.168638:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788482804.168648:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014e6d29d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:5830:x1875360072336512:12345-0@lo:502: 00000100:00100000:3.0:1788482804.168895:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014e6d29d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:5830:x1875360072336512:12345-0@lo:502: Request processed in 249us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482804.168903:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482804.168966:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000709da28f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5830:1875360072336512:0@lo:502: 00000020:01000000:0.0:1788482804.168996:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482804.169007:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482804.169010:0:5830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788482804.169015:0:5830:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788482804.169018:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788482804.169039:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000c1ce99d) 00000020:00000080:0.0:1788482804.169067:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788482804.169074:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788482804.169163:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788482804.169170:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad78874 00000020:00000080:0.0:1788482804.169682:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788482804.169687:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482804.169690:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482804.169691:0:5830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788482804.169694:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482804.169698:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482804.169699:0:5830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788482804.169702:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788482804.169709:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e8d08338) 00000020:00000080:0.0:1788482804.169720:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788482804.169724:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788482804.169726:0:5830:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788482804.169729:0:5830:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788482804.169737:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788482804.169786:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e142337d from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788482804.169800:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000036603958) 00000020:00000080:0.0:1788482804.169808:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788482804.169883:0:5830:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788482804.169888:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad78889 00000020:00000080:0.0:1788482804.169988:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788482804.169995:0:5830:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788482804.169999:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42820277aad78890 00080000:01000000:0.0:1788482804.170003:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788482804.170006:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad78897 00080000:10000000:0.0:1788482804.170897:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788482804.171150:0:5830:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788482804.177009:0:5830:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788482804.291834:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788482804.292801:0:5830:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788482804.296045:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788482804.298859:0:5830:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788482804.350423:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c21e0ff2) 00000020:00000080:3.0:1788482804.350454:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788482804.350545:0:5830:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788482804.350554:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad788a5 00000020:00000080:2.0:1788482804.357572:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788482804.361919:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788482804.407621:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788482804.440707:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788482804.501018:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788482804.578944:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788482804.594799:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788482804.651294:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788482804.719653:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42820277aad788ac 00000020:00000080:0.0:1788482804.720987:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788482804.721005:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482804.721014:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482804.721016:0:5830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788482804.721019:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482804.721026:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482804.721028:0:5830:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788482804.721032:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788482804.721184:0:5830:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788482804.721199:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482804.721202:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482804.721203:0:5830:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788482804.721206:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482804.721208:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482804.721210:0:5830:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788482804.721213:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788482804.721214:0:5830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788482804.721336:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000709da28f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5830:1875360072336640:0@lo:502: 00000100:00100000:0.0:1788482804.721596:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482804.721704:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffcbc53e going to sleep for 11 seconds 00000100:00100000:2.0:1788482804.722020:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072336640 00000100:00100000:2.0:1788482804.722031:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072336640 00000100:00100000:2.0:1788482804.722214:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788482804.722224:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b1ce63f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:5830:x1875360072336640:12345-0@lo:502: 00000100:00100000:2.0:1788482804.722657:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b1ce63f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:5830:x1875360072336640:12345-0@lo:502: Request processed in 434us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482804.722665:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788482804.722761:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000709da28f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5830:1875360072336640:0@lo:502: 00000020:01000000:0.0:1788482804.722791:0:5830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482804.722797:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482804.722799:0:5830:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788482804.722803:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788482804.722996:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788482804.723025:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788482804.723048:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000c3a9aa05/0x42820277aad7885f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.723067:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000c3a9aa05/0x42820277aad7885f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482804.723077:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eb9070c3000 from 1 10000000:01000000:3.0:1788482804.723080:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788482804.723123:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.723130:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.723138:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482804.723155:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d4e3540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336768:0@lo:101: 00000100:00100000:3.0:1788482804.723202:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.723988:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9f636e5 going to sleep for 11 seconds 00000100:00100000:1.0:1788482804.724080:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072336768 00000100:00100000:1.0:1788482804.724091:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072336768 00000100:00100000:1.0:1788482804.724175:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788482804.724185:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d12bad11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:5789:x1875360072336768:12345-0@lo:101: 00010000:00010000:1.0:1788482804.724201:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482804.724217:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad788b3 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.724245:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad788b3 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.724274:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad788b3 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.724283:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b58e2c29, rc 0) 00000100:00100000:1.0:1788482804.724356:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d12bad11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+10:5789:x1875360072336768:12345-0@lo:101: Request processed in 173us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482804.724364:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482804.725232:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d4e3540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336768:0@lo:101: 00010000:00010000:3.0:1788482804.725285:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.725297:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482804.725815:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d4e3540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336896:0@lo:256: 00000100:00100000:3.0:1788482804.725897:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.725947:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9f636e5 going to sleep for 11 seconds 00000100:00100000:1.0:1788482804.726173:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072336896 00000100:00100000:1.0:1788482804.726182:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072336896 00000100:00100000:1.0:1788482804.726225:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788482804.726233:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b37dca39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+10:5789:x1875360072336896:12345-0@lo:256: 20000000:01000000:1.0:1788482804.726283:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788482804.726289:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788482804.726996:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b37dca39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+10:5789:x1875360072336896:12345-0@lo:256: Request processed in 762us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482804.727006:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788482804.727090:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d4e3540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072336896:0@lo:256: 10000000:01000000:3.0:1788482804.727660:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788482804.727680:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.727692:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482804.727700:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb9070c3000 from 1 10000000:01000000:3.0:1788482804.727703:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788482804.727738:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.727745:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.727755:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482804.727773:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d4e3540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337024:0@lo:101: 00000100:00100000:3.0:1788482804.727814:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.727851:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9f636e5 going to sleep for 11 seconds 00000100:00100000:1.0:1788482804.728094:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072337024 00000100:00100000:1.0:1788482804.728102:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072337024 00000100:00100000:1.0:1788482804.728155:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788482804.728163:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064fabf91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+10:5789:x1875360072337024:12345-0@lo:101: 00010000:00010000:1.0:1788482804.728189:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482804.728205:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad788c1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.728226:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad788c1 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.728234:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad788c1 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.728242:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b4989ed, rc 0) 00000100:00100000:1.0:1788482804.728281:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064fabf91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5789:x1875360072337024:12345-0@lo:101: Request processed in 120us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482804.728288:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788482804.728442:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d4e3540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337024:0@lo:101: 00010000:00010000:3.0:1788482804.728457:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.728466:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482804.728530:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d4e3540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337152:0@lo:501: 00000100:00100000:3.0:1788482804.728552:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.728581:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9f636e5 going to sleep for 11 seconds 00000100:00100000:1.0:1788482804.729619:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072337152 00000100:00100000:1.0:1788482804.729630:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072337152 00000100:00100000:1.0:1788482804.729671:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788482804.729678:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a713620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5789:x1875360072337152:12345-0@lo:501: 00000100:00100000:1.0:1788482804.730301:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a713620 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5789:x1875360072337152:12345-0@lo:501: Request processed in 623us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482804.730310:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788482804.730592:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d4e3540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337152:0@lo:501: 00000100:00100000:1.0:1788482804.730641:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337280:0@lo:503: 00000100:00100000:1.0:1788482804.730684:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482804.730768:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cbbe3449 going to sleep for 11 seconds 00000100:00100000:2.0:1788482804.730834:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072337280 00000100:00100000:2.0:1788482804.730841:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072337280 00000100:00100000:0.0:1788482804.731077:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788482804.731091:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3d902f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5789:x1875360072337280:12345-0@lo:503: 00000040:00080000:0.0:1788482804.731150:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788482804.731209:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3d902f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5789:x1875360072337280:12345-0@lo:503: Request processed in 123us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482804.731222:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788482804.731329:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337280:0@lo:503: 00000040:00080000:1.0:1788482804.732046:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788482804.732132:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788482804.732155:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788482804.732171:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.732183:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482804.732226:0:5789:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788482804.732229:0:5789:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eb9070c3000 10000000:01000000:1.0:1788482804.732232:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eb9070c3000 10000000:01000000:1.0:1788482804.732236:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788482804.732243:0:5789:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb9070c3000 from 1 10000000:01000000:1.0:1788482804.732246:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482804.732295:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000e729c338/0x42820277aad788cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.732302:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000e729c338/0x42820277aad788cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.732311:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000e729c338/0x42820277aad788cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482804.732984:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337408:0@lo:101: 00000100:00100000:1.0:1788482804.733060:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482804.733441:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000371f5c43 going to sleep for 11 seconds 00000100:00100000:3.0:1788482804.733862:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072337408 00000100:00100000:3.0:1788482804.733872:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072337408 00000100:00100000:3.0:1788482804.733920:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788482804.733930:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a8cba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5789:x1875360072337408:12345-0@lo:101: 00010000:00010000:3.0:1788482804.733949:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482804.733967:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f2458f2/0x42820277aad788d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad788cf expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.733993:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f2458f2/0x42820277aad788d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad788cf expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.734004:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f2458f2/0x42820277aad788d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad788cf expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.734012:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f2458f2, rc 0) 00000100:00100000:3.0:1788482804.734074:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a8cba5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5789:x1875360072337408:12345-0@lo:101: Request processed in 146us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482804.734081:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788482804.734234:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337408:0@lo:101: 00010000:00010000:1.0:1788482804.734286:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000e729c338/0x42820277aad788cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.734313:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000e729c338/0x42820277aad788cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482804.734716:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337536:0@lo:501: 00000100:00100000:1.0:1788482804.734753:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482804.734792:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000371f5c43 going to sleep for 11 seconds 00000100:00100000:3.0:1788482804.734841:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072337536 00000100:00100000:3.0:1788482804.734847:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072337536 00000100:00100000:3.0:1788482804.734884:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788482804.734890:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca437809 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5789:x1875360072337536:12345-0@lo:501: 00000100:00100000:3.0:1788482804.735230:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca437809 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5789:x1875360072337536:12345-0@lo:501: Request processed in 339us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482804.735246:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788482804.735488:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337536:0@lo:501: 00000100:00100000:1.0:1788482804.735518:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337664:0@lo:503: 00000100:00100000:1.0:1788482804.735557:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482804.735590:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 00000000371f5c43 going to sleep for 11 seconds 00000100:00100000:3.0:1788482804.735661:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072337664 00000100:00100000:3.0:1788482804.735666:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072337664 00000100:00100000:3.0:1788482804.735696:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788482804.735703:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aea3394 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5789:x1875360072337664:12345-0@lo:503: 00000100:00100000:3.0:1788482804.735885:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aea3394 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5789:x1875360072337664:12345-0@lo:503: Request processed in 183us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482804.735893:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788482804.736008:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072337664:0@lo:503: 00000100:00100000:3.0:1788482804.736569:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2636c16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5835:1875360072337792:0@lo:502: 00000100:00100000:3.0:1788482804.736614:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.736647:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 00000000528eed06 going to sleep for 11 seconds 00000100:00100000:1.0:1788482804.736695:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072337792 00000100:00100000:1.0:1788482804.736702:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072337792 00000100:00100000:1.0:1788482804.736742:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788482804.736750:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a6f3671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5835:x1875360072337792:12345-0@lo:502: 00000100:00100000:1.0:1788482804.736953:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a6f3671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5835:x1875360072337792:12345-0@lo:502: Request processed in 203us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482804.736961:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788482804.737085:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2636c16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5835:1875360072337792:0@lo:502: 00000020:01000004:3.0:1788482804.737161:0:5835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788482804.737178:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006c8755ed) 00000020:00000080:3.0:1788482804.737204:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788482804.737332:0:5835:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e142337d from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788482804.737337:0:5835:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e142337d from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788482804.737419:0:5835:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e142337d 4 00010000:00080000:3.0:1788482804.737456:0:5835:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f3695586@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788482804.744570:0:5835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788482804.744886:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788482804.744939:0:5835:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788482804.744957:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42820277aad788e4 00000100:00080000:3.0:1788482804.744972:0:5835:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788482804.744979:0:5835:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f3695586 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788482804.745039:0:5835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d2636c16 x1875360072337920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788482804.745093:0:5835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788482804.745787:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2636c16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072337920:0@lo:38: 00000100:00100000:0.0:1788482804.745896:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.746042:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072337920 00000100:00100000:3.0:1788482804.746052:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072337920 00000100:00100000:3.0:1788482804.746103:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482804.746124:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000709da28f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3276:x1875360072337920:12345-0@lo:38: 00000100:00100000:3.0:1788482804.746225:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000709da28f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3276:x1875360072337920:12345-0@lo:38: Request processed in 111us (329us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788482804.746234:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788482804.747806:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788482804.747820:0:3276:0:(import.c:65:import_set_state_nolock()) 00000000f3695586 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788482804.747826:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788482804.747831:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2636c16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072337920:0@lo:38: 00000100:00100000:3.0:1788482804.748308:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000339c85ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5835:1875360072338048:0@lo:502: 00000100:00100000:3.0:1788482804.748415:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.748469:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073234097 going to sleep for 11 seconds 00000100:00100000:0.0:1788482804.748791:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072338048 00000100:00100000:0.0:1788482804.748801:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072338048 00000100:00100000:0.0:1788482804.748870:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788482804.748880:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4143b1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5835:x1875360072338048:12345-0@lo:502: 00000100:00100000:0.0:1788482804.749154:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4143b1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5835:x1875360072338048:12345-0@lo:502: Request processed in 275us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482804.749161:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788482804.750172:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000339c85ce pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5835:1875360072338048:0@lo:502: 00000040:00080000:3.0:1788482804.750231:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788482804.750576:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788482804.750606:0:5789:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788482804.750649:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000e729c338/0x42820277aad788cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.750662:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000e729c338/0x42820277aad788cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788482804.750724:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788482804.750727:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788482804.750729:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482804.750731:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788482804.750732:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482804.750733:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482804.750735:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482804.750737:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788482804.750739:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788482804.750741:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788482804.750743:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482804.750744:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788482804.750749:0:5789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788482804.750752:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788482804.750753:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788482804.750754:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788482804.750756:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788482804.750757:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788482804.750758:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788482804.750759:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788482804.750760:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788482804.750762:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788482804.750763:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788482804.750764:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788482804.750765:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788482804.750811:0:5789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788482804.750829:0:5789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072338176:0@lo:253: 00000100:00100000:1.0:1788482804.750985:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482804.751041:0:5789:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c16937d going to sleep for 11 seconds 00000100:00100000:0.0:1788482804.751203:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072338176 00000100:00100000:0.0:1788482804.751211:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072338176 00000100:00100000:3.0:1788482804.755894:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788482804.755913:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001640a752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5789:x1875360072338176:12345-0@lo:253: 20000000:01000000:3.0:1788482804.755951:0:5801:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788482804.755965:0:5801:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788482804.822604:0:5801:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788482804.822629:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788482804.823001:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788482804.823010:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788482804.823043:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.823079:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad788b3 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.823088:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.823163:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad788b3 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.823181:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad788b3 expref: 12 pid: 5801 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482804.823201:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000339c85ce pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875360072338304:0@lo:104: 00000100:00100000:3.0:1788482804.823321:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482804.823634:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a49fcaee going to sleep for 11 seconds 00000100:00100000:1.0:1788482804.823766:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072338304 00000100:00100000:1.0:1788482804.823775:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072338304 00000100:00100000:1.0:1788482804.823928:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788482804.823939:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064ea97bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5823:x1875360072338304:12345-0@lo:104: 00010000:00010000:1.0:1788482804.823955:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482804.824027:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788482804.824033:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064ea97bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5823:x1875360072338304:12345-0@lo:104: Request processed in 97us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482804.824039:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788482804.824138:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482804.824145:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.824153:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d619ba0 already unused, calling callback (000000009010ffb1) 10000000:00010000:0.0:1788482804.824157:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.824165:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482804.824173:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482804.824180:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482804.824210:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.824227:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482804.824272:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.824279:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: 000000004d619ba0/0x42820277aad788b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788ba expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.824301:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482804.824302:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482804.824304:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482804.824390:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000339c85ce pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875360072338304:0@lo:104: 00010000:00010000:3.0:1788482804.824415:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482804.824653:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482804.824664:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e790963 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072338432:0@lo:103: 00000100:00100000:2.0:1788482804.824705:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482804.825767:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072338432 00000100:00100000:0.0:1788482804.825777:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072338432 00010000:00010000:0.0:1788482804.825801:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad788b3 expref: 13 pid: 5801 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482804.825834:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788482804.825842:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddb49dfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3277:x1875360072338432:12345-0@lo:103: 00010000:00010000:0.0:1788482804.825964:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482804.825971:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad788b3 expref: 13 pid: 5801 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.825983:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad788b3 expref: 13 pid: 5801 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.825999:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b58e2c29/0x42820277aad788ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad788b3 expref: 13 pid: 5801 timeout: 271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.826015:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.826039:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788482804.826131:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003122919s 00010000:00010000:0.0:1788482804.826136:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.826143:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.826150:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.826156:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.826161:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edbade0f already unused, calling callback (00000000710d7972) 00010000:00010000:0.0:1788482804.826165:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.826172:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.829647:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482804.829668:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.829784:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.829795:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000edbade0f/0x42820277aad788eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482804.829817:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482804.830069:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddb49dfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3277:x1875360072338432:12345-0@lo:103: Request processed in 4223us (5359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482804.830084:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482804.830511:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e790963 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072338432:0@lo:103: 00000100:00100000:1.0:1788482804.832515:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001640a752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5789:x1875360072338176:12345-0@lo:253: Request processed in 76598us (81520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482804.832533:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788482804.832544:0:5789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d290948 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5789:1875360072338176:0@lo:253: 10000000:01000000:2.0:1788482804.832563:0:5789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788482804.832566:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788482804.832568:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788482804.832569:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788482804.832570:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788482804.832571:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788482804.832572:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788482804.832574:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788482804.832575:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788482804.832576:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788482804.832578:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788482804.832579:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788482804.832581:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788482804.832593:0:5789:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788482804.841190:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788482804.841810:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788482804.842144:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788482804.842578:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788482804.842781:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788482804.843042:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788482804.849839:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788482804.852791:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788482804.853142:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788482804.853682:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788482804.854284:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788482804.854934:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788482804.994003:0:5789:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:0.0:1788482805.055899:0:5840:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788482805.055909:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788482805.055965:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788482805.056572:0:5841:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788482805.066747:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788482805.067139:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788482805.068162:0:5789:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788482805.068181:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788482805.068471:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788482805.074742:0:5789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788482805.075831:0:5789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788482805.075978:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788482805.076943:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788482805.077216:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788482805.085962:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788482805.088274:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788482805.089426:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788482805.091591:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788482805.091802:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788482805.091966:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788482805.092145:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788482805.092335:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788482805.092486:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788482805.092634:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788482805.092776:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788482805.092932:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788482805.093075:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788482805.093242:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788482805.093472:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788482805.093644:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788482805.093976:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788482805.094944:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788482805.095186:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788482805.095386:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788482805.095533:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788482805.095714:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788482805.095877:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788482805.096029:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788482805.096193:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788482805.096406:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788482805.096551:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788482805.096705:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788482805.096850:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788482805.096994:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788482805.097175:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788482805.097368:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788482805.097610:0:5789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788482805.129593:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788482805.224325:0:5789:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788482805.224369:0:5789:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc16683bc3988 00100000:10000000:2.0:1788482805.224377:0:5789:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788482805.225832:0:5789:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788482805.225852:0:5789:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788482805.225870:0:5789:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788482805.225896:0:5789:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788482805.341874:0:5841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788482805.341981:0:5841:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788482805.341986:0:5841:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788482805.619662:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482806.643002:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482807.666619:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482808.691405:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482809.716129:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788482809.779193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788482809.779203:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788482809.779207:0:8:0:(import.c:65:import_set_state_nolock()) 00000000f3695586 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788482809.779221:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f3695586 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788482809.779244:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000073633561 x1875360072338688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788482809.779319:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073633561 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072338688:0@lo:38: 00000100:00100000:0.0:1788482809.779392:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482809.779470:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072338688 00000100:00100000:0.0:1788482809.779479:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072338688 00000100:00100000:0.0:1788482809.779517:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482809.779526:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaafca64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3276:x1875360072338688:12345-0@lo:38: 00000100:00100000:1.0:1788482809.779806:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9ad0454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072338560:0@lo:400: 00000100:00100000:1.0:1788482809.779849:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482809.780219:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072338560 00000100:00100000:3.0:1788482809.780225:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072338560 00000100:00100000:3.0:1788482809.780270:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482809.780277:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e779c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:3279:x1875360072338560:12345-0@lo:400: 00000100:00100000:3.0:1788482809.780334:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e779c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:3279:x1875360072338560:12345-0@lo:400: Request processed in 59us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482809.780341:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482809.780392:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9ad0454 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072338560:0@lo:400: 00010000:00080000:0.0:1788482809.780485:0:5809:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 126 last 0 00000020:00000080:0.0:1788482809.780532:0:5809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42820277aad788f2 00000004:00100000:0.0:1788482809.780797:0:5809:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788482809.780948:0:5809:0:(import.c:65:import_set_state_nolock()) 0000000017fdf3b6 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482809.781014:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaafca64 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875360072338688:12345-0@lo:38: Request processed in 1487us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482809.781021:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788482809.781115:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000073633561 x1875360072338688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788482809.781132:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788482809.781139:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788482809.781144:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788482809.781146:0:3276:0:(import.c:65:import_set_state_nolock()) 00000000f3695586 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788482809.781151:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073633561 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072338688:0@lo:38: 00000001:02000400:0.0:1788482810.051887:0:6084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788482810.293104:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788482810.293118:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eb9070c3000 from 3 10000000:01000000:3.0:1788482810.293123:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788482810.293173:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 0000000067587042/0x42820277aad788f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482810.293188:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 0000000067587042/0x42820277aad788f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482810.293199:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 0000000067587042/0x42820277aad788f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482810.293224:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000339c85ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072338816:0@lo:101: 00000100:00100000:3.0:1788482810.294127:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482810.294176:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set 00000000973c2aef going to sleep for 11 seconds 00000100:00100000:1.0:1788482810.296401:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072338816 00000100:00100000:1.0:1788482810.296420:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072338816 00000100:00100000:1.0:1788482810.296469:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788482810.296477:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007585c81b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5804:x1875360072338816:12345-0@lo:101: 00010000:00010000:1.0:1788482810.296494:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482810.296512:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008fb7ce38/0x42820277aad78900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad788f9 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482810.296538:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fb7ce38/0x42820277aad78900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad788f9 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482810.296547:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008fb7ce38/0x42820277aad78900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad788f9 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482810.296556:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008fb7ce38, rc 0) 00000100:00100000:1.0:1788482810.296632:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007585c81b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072338816:12345-0@lo:101: Request processed in 156us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482810.296639:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788482810.296697:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000339c85ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072338816:0@lo:101: 00010000:00010000:1.0:1788482810.296716:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 0000000067587042/0x42820277aad788f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482810.296725:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 0000000067587042/0x42820277aad788f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482810.296796:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8dc5397 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072338944:0@lo:256: 00000100:00100000:1.0:1788482810.296831:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482810.296874:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set 00000000266f0c6c going to sleep for 11 seconds 00000100:00100000:1.0:1788482810.296889:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072338944 00000100:00100000:1.0:1788482810.296894:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072338944 00000100:00100000:1.0:1788482810.296916:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788482810.296922:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c707827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072338944:12345-0@lo:256: 20000000:01000000:1.0:1788482810.296937:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788482810.297050:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788482810.297054:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788482810.297129:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c707827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072338944:12345-0@lo:256: Request processed in 207us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482810.297136:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788482810.297164:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8dc5397 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072338944:0@lo:256: 10000000:01000000:1.0:1788482810.297200:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788482810.297207:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 0000000067587042/0x42820277aad788f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482810.297213:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 0000000067587042/0x42820277aad788f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482810.738896:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482811.763523:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482812.786563:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482813.810509:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482814.840380:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482814.898916:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060f3d233 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072339200:0@lo:400: 00000100:00100000:0.0:1788482814.899035:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482814.899304:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8dc5397 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072339072:0@lo:400: 00000100:00100000:3.0:1788482814.899349:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482814.899904:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072339072 00000100:00100000:1.0:1788482814.899917:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072339072 00000100:00100000:1.0:1788482814.899999:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788482814.900011:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078b1dd79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3280:x1875360072339072:12345-0@lo:400: 00000100:00100000:1.0:1788482814.900092:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078b1dd79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3280:x1875360072339072:12345-0@lo:400: Request processed in 82us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482814.900099:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788482814.900381:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8dc5397 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072339072:0@lo:400: 00000100:00100000:2.0:1788482814.900540:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072339200 00000100:00100000:2.0:1788482814.900546:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072339200 00000100:00100000:2.0:1788482814.900581:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482814.900588:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b80b56d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072339200:12345-0@lo:400: 00000100:00100000:2.0:1788482814.900631:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b80b56d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072339200:12345-0@lo:400: Request processed in 45us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482814.900662:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788482814.900756:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000060f3d233 x1875360072339200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482814.900771:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060f3d233 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072339200:0@lo:400: 00000020:00000080:1.0:1788482815.062652:0:6286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda117e7e0 20000000:00000080:1.0:1788482815.062677:0:6286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eb937dbb400 uarg=0000000000000000 20000000:01000000:1.0:1788482815.062734:0:6286:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788482815.062744:0:6286:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788482815.062751:0:6286:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788482815.063061:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788482815.063075:0:6286:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788482815.076756:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788482815.080500:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788482815.080618:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788482815.080675:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788482815.080697:0:6286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788482815.080723:0:6286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.080745:0:6286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad788c1 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.080754:0:6286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.080807:0:6286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad788c1 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.080828:0:6286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad788c1 expref: 11 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482815.080844:0:6286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca324a0b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1875360072339328:0@lo:104: 00000100:00100000:1.0:1788482815.080923:0:6286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482815.084156:0:6286:0:(client.c:2715:ptlrpc_set_wait()) set 00000000197a4a25 going to sleep for 11 seconds 00000100:00100000:2.0:1788482815.088382:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072339328 00000100:00100000:2.0:1788482815.088407:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072339328 00000100:00100000:2.0:1788482815.088498:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788482815.088512:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034b96a27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:6286:x1875360072339328:12345-0@lo:104: 00010000:00010000:2.0:1788482815.088539:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.088696:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788482815.088725:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482815.088741:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.088779:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026d345d6 already unused, calling callback (000000009010ffb1) 10000000:00010000:1.0:1788482815.088782:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.088791:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482815.088797:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482815.088803:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788482815.088852:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.088859:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482815.088879:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.088886:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: 0000000026d345d6/0x42820277aad788c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788c8 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.088906:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482815.088908:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482815.088910:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482815.088932:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034b96a27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:6286:x1875360072339328:12345-0@lo:104: Request processed in 195us (7780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482815.088947:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000540728a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072339456:0@lo:103: 00000100:00100000:2.0:1788482815.088957:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482815.089020:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482815.089140:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072339456 00000100:00100000:2.0:1788482815.089146:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072339456 00010000:00010000:2.0:1788482815.089236:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad788c1 expref: 12 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482815.089294:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788482815.089302:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d52d1dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3278:x1875360072339456:12345-0@lo:103: 00010000:00010000:2.0:1788482815.089313:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482815.089319:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad788c1 expref: 12 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089330:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad788c1 expref: 12 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089406:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089430:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089448:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089455:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089461:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089467:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089472:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b58e2c29 already unused, calling callback (00000000710d7972) 00010000:00010000:2.0:1788482815.089476:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089483:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089491:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482815.089501:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482815.089546:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d52d1dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3278:x1875360072339456:12345-0@lo:103: Request processed in 246us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482815.089553:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482815.089727:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000540728a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072339456:0@lo:103: 00010000:00010000:0.0:1788482815.094384:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b4989ed/0x42820277aad788c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad788c1 expref: 11 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482815.094426:0:6286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca324a0b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1875360072339328:0@lo:104: 00010000:00010000:0.0:1788482815.094464:0:6286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482815.094476:0:6286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482815.094483:0:6286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482815.094490:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b58e2c29/0x42820277aad78907 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482815.863750:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482816.882472:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482817.906335:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482818.931383:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482819.957214:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788482820.018382:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788482820.018392:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb9070c3000 from 1 10000000:01000000:1.0:1788482820.018398:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788482820.018483:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000006b4989ed/0x42820277aad7890e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482820.018497:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000006b4989ed/0x42820277aad7890e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482820.018508:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000006b4989ed/0x42820277aad7890e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482820.018538:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000540728a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072339584:0@lo:101: 00000100:00100000:1.0:1788482820.018629:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482820.018709:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set 000000001392c0ec going to sleep for 11 seconds 00000100:00100000:3.0:1788482820.018805:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072339584 00000100:00100000:3.0:1788482820.018815:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072339584 00000100:00100000:3.0:1788482820.018889:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788482820.018897:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8a185ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:5804:x1875360072339584:12345-0@lo:101: 00010000:00010000:3.0:1788482820.018915:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482820.018932:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079a6f398/0x42820277aad78915 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad7890e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482820.018962:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079a6f398/0x42820277aad78915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad7890e expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482820.018998:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079a6f398/0x42820277aad78915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad7890e expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482820.019007:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079a6f398, rc 0) 00000100:00100000:3.0:1788482820.019058:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8a185ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072339584:12345-0@lo:101: Request processed in 162us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482820.019063:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482820.019294:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000540728a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072339584:0@lo:101: 00010000:00010000:2.0:1788482820.019315:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000006b4989ed/0x42820277aad7890e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482820.019323:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000006b4989ed/0x42820277aad7890e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482820.019385:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048213e36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072339712:0@lo:501: 00000100:00100000:2.0:1788482820.019410:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482820.019498:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072339712 00000100:00100000:1.0:1788482820.019502:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072339712 00000100:00100000:1.0:1788482820.019521:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788482820.019525:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe9bfdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072339712:12345-0@lo:501: 00000100:00100000:1.0:1788482820.019819:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe9bfdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072339712:12345-0@lo:501: Request processed in 292us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482820.019824:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482820.019893:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b5e640b going to sleep for 11 seconds 00000100:00100000:2.0:1788482820.019906:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048213e36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072339712:0@lo:501: 00000100:00100000:2.0:1788482820.019937:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048213e36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072339840:0@lo:503: 00000100:00100000:2.0:1788482820.019981:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482820.020092:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b5e640b going to sleep for 11 seconds 00000100:00100000:1.0:1788482820.020333:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072339840 00000100:00100000:1.0:1788482820.020339:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072339840 00000100:00100000:1.0:1788482820.020415:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788482820.020434:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8461804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072339840:12345-0@lo:503: 00000100:00100000:1.0:1788482820.020776:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8461804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072339840:12345-0@lo:503: Request processed in 353us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482820.020791:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788482820.020811:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048213e36 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072339840:0@lo:503: 00000100:00100000:3.0:1788482820.020963:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482820.020980:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b22f237e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072339968:0@lo:400: 00000100:00100000:3.0:1788482820.021023:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482820.021064:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072339968 00000100:00100000:0.0:1788482820.021069:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072339968 00000100:00100000:3.0:1788482820.021216:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788482820.021229:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000061b674c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072339968:12345-0@lo:400: 00000100:00100000:3.0:1788482820.021290:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000061b674c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072339968:12345-0@lo:400: Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482820.021297:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788482820.021324:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b22f237e x1875360072339968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482820.021338:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b22f237e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072339968:0@lo:400: 00000100:00100000:0.0:1788482820.021700:0:6587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b22f237e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6587:1875360072340096:0@lo:502: 00000100:00100000:0.0:1788482820.021742:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482820.021774:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072340096 00000100:00100000:0.0:1788482820.021775:0:6587:0:(client.c:2715:ptlrpc_set_wait()) set 00000000242ffc61 going to sleep for 11 seconds 00000100:00100000:1.0:1788482820.021780:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072340096 00000100:00100000:1.0:1788482820.021812:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788482820.021819:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7dd24c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6587:x1875360072340096:12345-0@lo:502: 00000100:00100000:1.0:1788482820.022039:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7dd24c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6587:x1875360072340096:12345-0@lo:502: Request processed in 221us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482820.022048:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788482820.022071:0:6587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b22f237e pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6587:1875360072340096:0@lo:502: 00000020:01000000:0.0:1788482820.022103:0:6587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482820.022236:0:6587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482820.022240:0:6587:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788482820.022268:0:6587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb9070c3000 00000020:00000080:0.0:1788482820.022271:0:6587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788482820.022322:0:6587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6587:1875360072340224:0@lo:502: 00000100:00100000:0.0:1788482820.022354:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482820.022379:0:6587:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93a067480 going to sleep for 11 seconds 00000100:00100000:2.0:1788482820.022395:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072340224 00000100:00100000:2.0:1788482820.022401:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072340224 00000100:00100000:2.0:1788482820.022471:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788482820.022480:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6587:x1875360072340224:12345-0@lo:502: 00000100:00100000:2.0:1788482820.022590:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6587:x1875360072340224:12345-0@lo:502: Request processed in 111us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482820.022597:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788482820.022619:0:6587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6587:1875360072340224:0@lo:502: 00000020:01000000:0.0:1788482820.022638:0:6587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482820.022642:0:6587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482820.022644:0:6587:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788482820.022648:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788482820.022727:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788482820.022757:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788482820.022769:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482820.022782:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482820.980384:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788482821.517508:0:6657:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788482821.517514:0:6657:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788482821.517689:0:6657:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eb906309000 00000020:01000004:3.0:1788482821.517711:0:6657:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788482821.517727:0:6657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788482821.517749:0:6657:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9eb9208819b8) 00000020:00000080:3.0:1788482821.517772:0:6657:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788482821.537609:0:6657:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788482821.537914:0:6657:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788482821.575173:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788482821.582607:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788482821.582657:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788482821.582734:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788482821.582767:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788482821.583753:0:6657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788482821.583768:0:6657:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788482821.583781:0:6657:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42820277aad78923 00000020:01000004:0.0:1788482821.583792:0:6657:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788482821.583818:0:6657:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788482821.583834:0:6657:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788482821.583841:0:6657:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788482821.583848:0:6657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788482821.583865:0:6657:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9eb92ec50000) 00000020:00000080:0.0:1788482821.583879:0:6657:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1788482821.587611:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788482821.587904:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788482821.587913:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788482821.595844:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788482821.595876:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788482821.602870:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788482821.602900:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788482821.605712:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482821.606020:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788482821.606029:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788482821.610591:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788482821.610624:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788482821.645209:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788482821.646191:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788482821.646201:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788482821.648629:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788482821.648655:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788482821.651206:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788482821.651225:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788482821.660102:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788482821.660363:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788482821.660369:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788482821.661485:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788482821.661496:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788482821.728698:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788482821.729018:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788482821.729032:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788482821.731528:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788482821.731544:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788482821.732682:0:6657:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788482821.732714:0:6657:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788482821.732723:0:6657:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788482821.773977:0:6657:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788482821.774039:0:6657:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788482821.774044:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788482821.774047:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788482821.774048:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482821.774049:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482821.774051:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482821.774052:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482821.774054:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482821.774055:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482821.774057:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482821.774059:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482821.774061:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788482821.774065:0:6657:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788482821.774068:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788482821.774070:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788482821.774071:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482821.774072:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482821.774074:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482821.774075:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482821.774076:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482821.774077:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482821.774078:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482821.774079:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482821.774080:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788482821.774132:0:6657:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788482821.774165:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072340352:0@lo:253: 00000100:00100000:3.0:1788482821.774336:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.774429:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb904c28840 going to sleep for 11 seconds 00000100:00100000:1.0:1788482821.774870:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072340352 00000100:00100000:1.0:1788482821.774881:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072340352 00000100:00100000:1.0:1788482821.774949:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788482821.774963:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072340352:12345-0@lo:253: 20000000:01000000:1.0:1788482821.775023:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788482821.775035:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788482821.775044:0:5800:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788482821.775048:0:5800:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788482821.777975:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482821.778907:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788482821.778939:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788482821.779015:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788482821.779024:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788482821.779071:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788482821.779731:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788482821.780920:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788482821.780957:0:5800:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:0.0:1788482821.780960:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788482821.780997:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788482821.781005:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788482821.781068:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788482821.781076:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1788482821.781391:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788482821.781402:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788482821.781449:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788482821.781493:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788482821.784240:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788482821.784711:0:5800:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:1.0:1788482821.784715:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:1.0:1788482821.784771:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788482821.784780:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788482821.784811:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788482821.784830:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:1.0:1788482821.784885:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788482821.784895:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788482821.784927:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788482821.784961:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788482821.784981:0:5800:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788482821.784984:0:5800:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788482821.784989:0:5800:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788482821.785005:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788482821.785009:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788482821.785186:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788482821.785191:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788482821.786526:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788482821.786692:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788482821.786758:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788482821.787668:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788482821.787722:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788482821.787755:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788482821.787771:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788482821.787775:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788482821.788919:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788482821.789755:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788482821.789828:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788482821.789953:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788482821.789970:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788482821.789974:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788482821.791226:0:6675:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1788482821.791643:0:6675:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1788482821.791707:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788482821.792242:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788482821.792535:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788482821.792690:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788482821.792716:0:5800:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788482821.792719:0:5800:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788482821.792736:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788482821.792770:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.792796:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb900030200/0x42820277aad7884a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78843 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.792805:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb900031800/0x42820277aad78866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad7885f expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.792812:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901492400/0x42820277aad788d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad788cf expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.792855:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.792925:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901492400/0x42820277aad788d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad788cf expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.792944:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb901492400/0x42820277aad788d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad788cf expref: 12 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482821.792966:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875360072340480:0@lo:104: 00000100:00100000:0.0:1788482821.793199:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482821.793563:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb900031800/0x42820277aad78866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad7885f expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.793574:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb900031800/0x42820277aad78866 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad7885f expref: 12 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482821.793586:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875360072340608:0@lo:104: 00000100:00100000:0.0:1788482821.793615:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482821.793767:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb900030200/0x42820277aad7884a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78843 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.793778:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb900030200/0x42820277aad7884a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78843 expref: 12 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482821.793787:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875360072340736:0@lo:104: 00000100:00100000:0.0:1788482821.793810:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482821.793879:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072340480 00000100:00100000:2.0:1788482821.793889:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072340480 00000100:00100000:2.0:1788482821.793953:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072340608 00000100:00100000:2.0:1788482821.793964:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072340608 00000100:00100000:2.0:1788482821.793987:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482821.794001:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:5800:x1875360072340480:12345-0@lo:104: 00010000:00010000:2.0:1788482821.794020:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad788cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.794196:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482821.794205:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:5800:x1875360072340480:12345-0@lo:104: Request processed in 207us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.794212:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482821.794233:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482821.794239:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5800:x1875360072340608:12345-0@lo:104: 00010000:00010000:2.0:1788482821.794279:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad7885f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482821.794490:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb906340840 going to sleep for 11 seconds 00000100:00100000:0.0:1788482821.794522:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875360072340480:0@lo:104: 00000100:00100000:0.0:1788482821.794545:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875360072340608:0@lo:104: 00010000:00010000:3.0:1788482821.794700:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788482821.794711:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad788cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794720:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204be00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:3.0:1788482821.794726:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad788cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794735:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad788cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482821.794743:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad788cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482821.794750:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482821.794793:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad788cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794801:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482821.794838:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad788cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794845:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad788cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad788d6 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794865:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788482821.794868:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad7885f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794886:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b400 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:3.0:1788482821.794889:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad7885f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794895:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad7885f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482821.794901:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad7885f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482821.794905:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482821.794921:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad7885f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794927:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788482821.794944:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad7885f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794951:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad7885f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78866 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.794962:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482821.794964:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482821.794966:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482821.794998:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482821.795021:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072340864:0@lo:103: 00000100:00100000:3.0:1788482821.795083:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482821.795404:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072340992:0@lo:103: 00000100:00100000:0.0:1788482821.795433:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.795526:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072340864 00000100:00100000:3.0:1788482821.795533:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072340864 00010000:00010000:3.0:1788482821.795582:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901492400/0x42820277aad788d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad788cf expref: 13 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482821.795617:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072340992 00000100:00100000:3.0:1788482821.795620:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072340992 00010000:00010000:3.0:1788482821.795632:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb900031800/0x42820277aad78866 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad7885f expref: 14 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482821.795648:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482821.795656:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:3279:x1875360072340864:12345-0@lo:103: 00010000:00010000:3.0:1788482821.795669:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482821.795675:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901492400/0x42820277aad788d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad788cf expref: 14 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.795686:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901492400/0x42820277aad788d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad788cf expref: 14 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.795703:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492400/0x42820277aad788d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad788cf expref: 14 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.795718:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482821.795751:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3279:x1875360072340864:12345-0@lo:103: Request processed in 95us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.795758:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482821.795775:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788482821.795781:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3277:x1875360072340992:12345-0@lo:103: 00010000:00010000:3.0:1788482821.795789:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482821.795793:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb900031800/0x42820277aad78866 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad7885f expref: 12 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.795813:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb900031800/0x42820277aad78866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad7885f expref: 12 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.795833:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900031800/0x42820277aad78866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad7885f expref: 12 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.795844:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482821.795868:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:3277:x1875360072340992:12345-0@lo:103: Request processed in 88us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.795874:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788482821.795901:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072340864:0@lo:103: 00000100:00100000:0.0:1788482821.796031:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072340992:0@lo:103: 00010000:00010000:2.0:1788482821.796239:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788482821.796397:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5800:x1875360072340608:12345-0@lo:104: Request processed in 2009us (2632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.796406:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482821.796427:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072340736 00000100:00100000:2.0:1788482821.796431:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072340736 00000100:00100000:2.0:1788482821.796452:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482821.796458:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5800:x1875360072340736:12345-0@lo:104: 00010000:00010000:2.0:1788482821.796469:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb901493400/0x42820277aad78843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796517:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482821.796522:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5800:x1875360072340736:12345-0@lo:104: Request processed in 65us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.796534:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788482821.796564:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482821.796569:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb901493400/0x42820277aad78843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796576:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788482821.796581:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493400/0x42820277aad78843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796589:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb901493400/0x42820277aad78843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482821.796596:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493400/0x42820277aad78843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482821.796602:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482821.796636:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb901493400/0x42820277aad78843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796642:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482821.796656:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb901493400/0x42820277aad78843 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796663:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb901493400/0x42820277aad78843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad7884a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796682:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482821.796684:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482821.796685:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482821.796699:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482821.796716:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072341120:0@lo:103: 00000100:00100000:2.0:1788482821.796747:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482821.796785:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072341120 00000100:00100000:2.0:1788482821.796789:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072341120 00010000:00010000:2.0:1788482821.796805:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb900030200/0x42820277aad7884a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78843 expref: 11 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482821.796832:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482821.796839:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920897800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:3277:x1875360072341120:12345-0@lo:103: 00010000:00010000:2.0:1788482821.796848:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482821.796852:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb900030200/0x42820277aad7884a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78843 expref: 11 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796861:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb900030200/0x42820277aad7884a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78843 expref: 11 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796874:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796883:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796897:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796904:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796911:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796916:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796927:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900031000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788482821.796932:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796940:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796949:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.796962:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482821.796987:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920897800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:3277:x1875360072341120:12345-0@lo:103: Request processed in 149us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.796993:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482821.797021:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072341120:0@lo:103: 00010000:00010000:0.0:1788482821.797294:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900030200/0x42820277aad7884a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78843 expref: 10 pid: 5801 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482821.797307:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875360072340736:0@lo:104: 00010000:00010000:0.0:1788482821.797340:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.797350:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.797357:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.797364:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900031000/0x42820277aad78931 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788482821.797404:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788482821.797724:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482821.880416:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:6657:x1875360072340352:12345-0@lo:253: Request processed in 105441us (106065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.880434:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788482821.880695:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072340352:0@lo:253: 10000000:01000000:0.0:1788482821.880718:0:6657:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788482821.880723:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788482821.880725:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788482821.880726:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788482821.880727:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788482821.880729:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788482821.880730:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788482821.880753:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788482821.880756:0:6657:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788482821.880758:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788482821.880760:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788482821.880791:0:6657:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eb906309000 from lustre-OST0000 10000000:01000000:0.0:1788482821.880833:0:6657:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788482821.880837:0:6657:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788482821.880847:0:6657:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eb920884d28 local copy 10000000:01000000:0.0:1788482821.880852:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788482821.880900:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.880913:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.880923:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482821.880948:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341248:0@lo:101: 00000100:00100000:0.0:1788482821.880994:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482821.881478:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9063400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482821.882439:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072341248 00000100:00100000:3.0:1788482821.882460:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072341248 00000100:00100000:3.0:1788482821.882550:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788482821.882566:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:6657:x1875360072341248:12345-0@lo:101: 00010000:00010000:3.0:1788482821.882595:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482821.882626:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492400/0x42820277aad7893f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78938 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.882670:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492400/0x42820277aad7893f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78938 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.882685:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492400/0x42820277aad7893f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78938 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.882724:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492400, rc 0) 00000100:00100000:3.0:1788482821.882851:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+10:6657:x1875360072341248:12345-0@lo:101: Request processed in 289us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.882858:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788482821.883293:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341248:0@lo:101: 00010000:00010000:2.0:1788482821.883316:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.883326:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482821.883502:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341376:0@lo:501: 00000100:00100000:2.0:1788482821.883563:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482821.883612:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482821.883804:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072341376 00000100:00100000:3.0:1788482821.883814:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072341376 00000100:00100000:3.0:1788482821.883873:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788482821.883884:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+10:6657:x1875360072341376:12345-0@lo:501: 00000100:00100000:3.0:1788482821.885785:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+10:6657:x1875360072341376:12345-0@lo:501: Request processed in 1889us (2207us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788482821.885804:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788482821.892560:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341376:0@lo:501: 10000000:01000000:2.0:1788482821.892616:0:6657:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788482821.892732:0:6657:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788482821.892745:0:6657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.892773:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.892781:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.892825:0:6657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788482821.892862:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788482821.892863:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eb906309000 10000000:01000000:2.0:1788482821.892872:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788482821.892874:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482821.892883:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9eb920884d28 00010000:00010000:3.0:1788482821.892885:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900031000 already unused, calling callback (ffffffffc1d2bc20) 10000000:01000000:2.0:1788482821.892890:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:00010000:3.0:1788482821.892892:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482821.892896:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9eb920884d28 from 1 10000000:01000000:2.0:1788482821.892903:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788482821.892909:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788482821.892918:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482821.892924:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788482821.892956:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.892957:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.892972:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.892992:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482821.892996:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482821.893022:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341504:0@lo:101: 00000100:00100000:1.0:1788482821.893073:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788482821.893103:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.893111:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x42820277aad7893f expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482821.893128:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788482821.893134:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482821.893137:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482821.893140:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482821.893182:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788482821.893403:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072341504 00000100:00100000:0.0:1788482821.893411:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072341504 00000100:00100000:0.0:1788482821.893471:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788482821.893485:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+10:6657:x1875360072341504:12345-0@lo:101: 00010000:00010000:0.0:1788482821.893502:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482821.893520:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb900030200/0x42820277aad7894d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78946 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.893559:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900030200/0x42820277aad7894d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78946 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.893588:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb900030200/0x42820277aad7894d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78946 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.893598:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb900030200, rc 0) 00000100:00100000:0.0:1788482821.893655:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:6657:x1875360072341504:12345-0@lo:101: Request processed in 173us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482821.893661:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788482821.895330:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341504:0@lo:101: 00010000:00010000:3.0:1788482821.895360:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7894d expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.895373:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad7894d expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482821.895399:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788482821.895407:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7894d expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.895414:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7894d expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482821.895422:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788482821.895432:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788482821.895439:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788482821.895442:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788482821.895494:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.895502:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.895511:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482821.895531:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341760:0@lo:101: 00000100:00100000:3.0:1788482821.895598:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.895652:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb904c28a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482821.895678:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072341760 00000100:00100000:3.0:1788482821.895686:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072341760 00000100:00100000:3.0:1788482821.895733:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788482821.895742:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:6657:x1875360072341760:12345-0@lo:101: 00010000:00010000:3.0:1788482821.895756:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482821.895769:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78954 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.895790:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78954 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.895799:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78954 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.895808:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493800, rc 0) 00000100:00100000:3.0:1788482821.895859:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072341760:12345-0@lo:101: Request processed in 118us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.895866:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788482821.895915:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341760:0@lo:101: 00010000:00010000:3.0:1788482821.895925:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.895932:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482821.896052:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341888:0@lo:501: 00000100:00100000:3.0:1788482821.896077:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482821.896213:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072341888 00000100:00100000:2.0:1788482821.896225:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072341888 00000100:00100000:2.0:1788482821.896274:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788482821.896283:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072341888:12345-0@lo:501: 00000100:00100000:3.0:1788482821.896601:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb904c28a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482821.896847:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072341632:0@lo:103: 00000100:00100000:2.0:1788482821.896954:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072341888:12345-0@lo:501: Request processed in 670us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.896962:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788482821.897044:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072341888:0@lo:501: 00000100:00100000:3.0:1788482821.897080:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342016:0@lo:503: 00000100:00100000:3.0:1788482821.897212:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.897239:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb904c28a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482821.897316:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072342016 00000100:00100000:2.0:1788482821.897322:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072342016 00000100:00100000:2.0:1788482821.897362:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788482821.897371:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342016:12345-0@lo:503: 00000100:00100000:2.0:1788482821.897563:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342016:12345-0@lo:503: Request processed in 193us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.897571:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788482821.897691:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342016:0@lo:503: 00000040:00080000:3.0:1788482821.898068:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788482821.898242:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342144:0@lo:502: 00000100:00100000:3.0:1788482821.898398:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.898442:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb907103c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482821.898522:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.898609:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072341632 00000100:00100000:3.0:1788482821.898617:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072341632 00000100:00100000:2.0:1788482821.898719:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072342144 00000100:00100000:2.0:1788482821.898723:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072342144 00000100:00100000:2.0:1788482821.898760:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788482821.898770:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072342144:12345-0@lo:502: 00000100:00100000:2.0:1788482821.898993:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072342144:12345-0@lo:502: Request processed in 224us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.899001:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788482821.899036:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342144:0@lo:502: 00000100:00100000:3.0:1788482821.899079:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482821.899098:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3280:x1875360072341632:12345-0@lo:103: 00010000:00010000:3.0:1788482821.899110:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482821.899136:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492400/0x42820277aad7893f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78938 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.899165:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482821.899206:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:3280:x1875360072341632:12345-0@lo:103: Request processed in 120us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.899213:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482821.899290:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072341632:0@lo:103: 00000040:00080000:1.0:1788482821.899928:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788482821.900001:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788482821.900034:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788482821.900461:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788482821.900521:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788482821.900870:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788482821.900932:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342272:0@lo:502: 00000100:00100000:1.0:1788482821.901039:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482821.901195:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903188900 going to sleep for 11 seconds 00000100:00100000:0.0:1788482821.903076:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072342272 00000100:00100000:0.0:1788482821.903112:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072342272 00000100:00100000:0.0:1788482821.903237:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788482821.903275:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:6657:x1875360072342272:12345-0@lo:502: 00000100:00100000:0.0:1788482821.903671:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:6657:x1875360072342272:12345-0@lo:502: Request processed in 422us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482821.903680:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788482821.904173:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342272:0@lo:502: 00000040:00080000:1.0:1788482821.904448:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788482821.904470:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788482821.905514:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788482821.905527:0:6677:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788482821.905537:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482821.905540:0:6677:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788482821.905546:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788482821.905581:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9eb93f390000) 00000020:00000080:0.0:1788482821.905611:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788482821.905619:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788482821.905700:0:6677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb906309000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788482821.905710:0:6677:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788482821.905721:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42820277aad78969 00010000:00010000:1.0:1788482821.912106:0:6677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788482821.912581:0:6677:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788482821.924021:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788482821.924679:0:6677:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788482821.938537:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788482821.940849:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788482821.947179:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788482821.947203:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482821.947212:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482821.947214:0:6677:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788482821.947216:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482821.947221:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482821.947222:0:6677:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788482821.947224:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788482821.947225:0:6677:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788482821.947787:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482821.947793:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482821.947795:0:6677:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788482821.947800:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788482821.948016:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788482821.948104:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788482821.948128:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482821.948140:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482821.948149:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb906309000 from 1 10000000:01000000:1.0:1788482821.948151:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788482821.948207:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482821.948213:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482821.948224:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482821.948269:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342400:0@lo:101: 00000100:00100000:1.0:1788482821.948354:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482821.948528:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903188a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482821.948946:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072342400 00000100:00100000:2.0:1788482821.948957:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072342400 00000100:00100000:2.0:1788482821.949631:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788482821.949648:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:6657:x1875360072342400:12345-0@lo:101: 00010000:00010000:2.0:1788482821.949673:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482821.949704:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78970 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.949754:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78970 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.949769:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78970 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482821.949780:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d2200, rc 0) 00000100:00100000:2.0:1788482821.949888:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342400:12345-0@lo:101: Request processed in 245us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.949896:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788482821.949919:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342400:0@lo:101: 00010000:00010000:1.0:1788482821.949944:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482821.950401:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482821.950755:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342528:0@lo:501: 00000100:00100000:1.0:1788482821.950811:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482821.950924:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903188a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482821.950972:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072342528 00000100:00100000:3.0:1788482821.950980:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072342528 00000100:00100000:3.0:1788482821.951124:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788482821.951136:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342528:12345-0@lo:501: 00000100:00100000:3.0:1788482821.951469:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342528:12345-0@lo:501: Request processed in 336us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.951475:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788482821.952192:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342528:0@lo:501: 00000100:00100000:3.0:1788482821.952512:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342656:0@lo:503: 00000100:00100000:3.0:1788482821.952580:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.960161:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482821.960406:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072342656 00000100:00100000:2.0:1788482821.960421:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072342656 00000100:00100000:2.0:1788482821.960509:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788482821.960524:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342656:12345-0@lo:503: 00000100:00100000:2.0:1788482821.960962:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342656:12345-0@lo:503: Request processed in 440us (8380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.960972:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788482821.961565:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342656:0@lo:503: 00000040:00080000:3.0:1788482821.961992:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788482821.962086:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342784:0@lo:502: 00000100:00100000:3.0:1788482821.962152:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.962202:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482821.962720:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072342784 00000100:00100000:2.0:1788482821.962730:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072342784 00000100:00100000:2.0:1788482821.962788:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788482821.962798:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342784:12345-0@lo:502: 00000100:00100000:2.0:1788482821.963023:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342784:12345-0@lo:502: Request processed in 226us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.963030:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788482821.963171:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342784:0@lo:502: 00000040:00080000:3.0:1788482821.963615:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788482821.963676:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788482821.963713:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342912:0@lo:502: 00000100:00100000:3.0:1788482821.963770:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.963872:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482821.965454:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072342912 00000100:00100000:1.0:1788482821.965471:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072342912 00000100:00100000:1.0:1788482821.965534:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788482821.965546:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342912:12345-0@lo:502: 00000100:00100000:1.0:1788482821.965896:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072342912:12345-0@lo:502: Request processed in 350us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482821.965904:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788482821.966062:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072342912:0@lo:502: 00000040:00080000:0.0:1788482821.966294:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788482821.966314:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788482821.966999:0:6681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482821.967012:0:6681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482821.967015:0:6681:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788482821.967024:0:6681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb906309000 00000020:00000080:0.0:1788482821.967026:0:6681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788482821.967051:0:6681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482821.967054:0:6681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482821.967056:0:6681:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788482821.967059:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788482821.967358:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788482821.967383:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788482821.967404:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482821.967417:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482821.967465:0:6657:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788482821.967469:0:6657:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eb906309000 10000000:01000000:1.0:1788482821.967473:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eb906309000 10000000:01000000:1.0:1788482821.967477:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788482821.967484:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb906309000 from 1 10000000:01000000:1.0:1788482821.967486:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482821.967531:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482821.967540:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482821.967552:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482821.967579:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343040:0@lo:101: 00000100:00100000:1.0:1788482821.967659:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482821.967717:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903188240 going to sleep for 11 seconds 00000100:00100000:3.0:1788482821.967794:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072343040 00000100:00100000:3.0:1788482821.967804:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072343040 00000100:00100000:3.0:1788482821.967866:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788482821.967876:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072343040:12345-0@lo:101: 00010000:00010000:3.0:1788482821.967891:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482821.967906:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad7897e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.967935:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad7897e expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.967947:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad7897e expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482821.967957:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492400, rc 0) 00000100:00100000:3.0:1788482821.967999:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343040:12345-0@lo:101: Request processed in 124us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.968006:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788482821.968212:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343040:0@lo:101: 00010000:00010000:1.0:1788482821.968227:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482821.968449:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482821.968564:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343168:0@lo:501: 00000100:00100000:1.0:1788482821.968597:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482821.968676:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903188240 going to sleep for 11 seconds 00000100:00100000:3.0:1788482821.968895:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072343168 00000100:00100000:3.0:1788482821.968902:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072343168 00000100:00100000:3.0:1788482821.968980:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788482821.968990:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343168:12345-0@lo:501: 00000100:00100000:3.0:1788482821.969463:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343168:12345-0@lo:501: Request processed in 336us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.969472:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788482821.969669:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343168:0@lo:501: 00000100:00100000:0.0:1788482821.969710:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343296:0@lo:503: 00000100:00100000:0.0:1788482821.969759:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482821.969957:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb906340480 going to sleep for 11 seconds 00000100:00100000:2.0:1788482821.970020:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072343296 00000100:00100000:2.0:1788482821.970026:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072343296 00000100:00100000:2.0:1788482821.970059:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788482821.970076:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343296:12345-0@lo:503: 00000100:00100000:2.0:1788482821.970478:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343296:12345-0@lo:503: Request processed in 404us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.970486:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788482821.970644:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343296:0@lo:503: 00000040:00080000:0.0:1788482821.971025:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788482821.971122:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343424:0@lo:502: 00000100:00100000:0.0:1788482821.971169:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482821.971300:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb906340480 going to sleep for 11 seconds 00000100:00100000:2.0:1788482821.971477:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072343424 00000100:00100000:2.0:1788482821.971484:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072343424 00000100:00100000:2.0:1788482821.971562:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788482821.971573:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343424:12345-0@lo:502: 00000100:00100000:2.0:1788482821.971791:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343424:12345-0@lo:502: Request processed in 220us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.971798:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788482821.971875:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343424:0@lo:502: 00000040:00080000:0.0:1788482821.972165:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788482821.972216:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788482821.972294:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788482821.972488:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788482821.972526:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788482821.972583:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788482821.972620:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788482821.972651:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788482821.972697:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788482821.972741:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788482821.972771:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788482821.972829:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788482821.972861:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788482821.972890:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788482821.972934:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788482821.972971:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788482821.973005:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788482821.973050:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788482821.973085:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788482821.973119:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788482821.973182:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788482821.973223:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788482821.973739:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788482821.973805:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788482821.973858:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788482821.973916:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788482821.973970:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788482821.974019:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788482821.974083:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343552:0@lo:502: 00000100:00100000:0.0:1788482821.974181:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482821.974959:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb906340480 going to sleep for 11 seconds 00000100:00100000:2.0:1788482821.975065:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072343552 00000100:00100000:2.0:1788482821.975076:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072343552 00000100:00100000:2.0:1788482821.975139:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788482821.975151:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343552:12345-0@lo:502: 00000100:00100000:2.0:1788482821.975637:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343552:12345-0@lo:502: Request processed in 486us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482821.975648:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788482821.975779:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343552:0@lo:502: 00000040:00080000:0.0:1788482821.975913:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788482821.975932:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788482821.976765:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788482821.976802:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9eb93f64cd28) 00000020:00000080:3.0:1788482821.976841:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788482821.976933:0:6682:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb906309000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788482821.976939:0:6682:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb906309000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788482821.976943:0:6682:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb906309000 3 00010000:00080000:3.0:1788482821.976981:0:6682:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb93f38a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788482821.980637:0:6682:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788482821.980918:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788482821.980963:0:6682:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788482821.980981:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x42820277aad78993 00000100:00080000:3.0:1788482821.980995:0:6682:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788482821.981003:0:6682:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eb93f38a000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788482821.981054:0:6682:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9406f4700 x1875360072343680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788482821.981089:0:6682:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788482821.981181:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072343808:0@lo:400: 00000100:00100000:3.0:1788482821.981305:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.984522:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072343808 00000100:00100000:3.0:1788482821.984544:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072343808 00000100:00100000:3.0:1788482821.984632:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482821.984646:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072343808:12345-0@lo:400: 00000100:00100000:3.0:1788482821.984782:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072343808:12345-0@lo:400: Request processed in 140us (3477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.984791:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788482821.984860:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eb9406f4a80 x1875360072343808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482821.984880:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072343808:0@lo:400: 00000040:00080000:3.0:1788482821.985283:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1788482821.985622:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3276:1875360072343680:0@lo:38: 00000100:00100000:1.0:1788482821.985688:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482821.988153:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072343680 00000100:00100000:3.0:1788482821.988179:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072343680 00000100:00100000:3.0:1788482821.988270:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482821.988281:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3276:x1875360072343680:12345-0@lo:38: 00010000:00080000:3.0:1788482821.988320:0:5807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:3.0:1788482821.988372:0:5807:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42820277aad7899a 00000004:00100000:3.0:1788482821.988396:0:5807:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788482821.988440:0:5807:0:(import.c:65:import_set_state_nolock()) ffff9eb93f38d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788482821.988555:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875360072343680:12345-0@lo:38: Request processed in 275us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482821.988565:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788482821.988630:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eb9406f4700 x1875360072343680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482821.988645:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482821.988659:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788482821.988668:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788482821.988674:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788482821.988677:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb93f38a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788482821.988683:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3276:1875360072343680:0@lo:38: 00000020:01000000:0.0:1788482821.989376:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788482821.989416:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788482821.989434:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482821.989446:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788482821.989518:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788482821.989521:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788482821.989522:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788482821.989523:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788482821.989524:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788482821.989526:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788482821.989527:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788482821.989529:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788482821.989531:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788482821.989533:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788482821.989534:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788482821.989539:0:6657:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788482821.989542:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788482821.989543:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788482821.989544:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788482821.989545:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788482821.989546:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788482821.989547:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788482821.989548:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788482821.989554:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788482821.989556:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788482821.989556:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788482821.989557:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788482821.989584:0:6657:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788482821.989606:0:6657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343936:0@lo:253: 00000100:00100000:0.0:1788482821.989668:0:6657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482821.989705:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072343936 00000100:00100000:0.0:1788482821.989712:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072343936 00000100:00100000:0.0:1788482821.989749:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788482821.989757:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6657:x1875360072343936:12345-0@lo:253: 20000000:01000000:0.0:1788482821.989798:0:5800:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1788482821.990648:0:6657:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb906340480 going to sleep for 11 seconds 20000000:01000000:0.0:1788482821.990872:0:5800:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1788482822.008671:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788482822.045348:0:5800:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788482822.045396:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788482822.045485:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788482822.045491:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788482822.045519:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482822.045542:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb94204a400/0x42820277aad78900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad788f9 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482822.045552:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482822.045610:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb94204a400/0x42820277aad78900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad788f9 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482822.045627:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb94204a400/0x42820277aad78900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad788f9 expref: 13 pid: 5801 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482822.045649:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875360072344064:0@lo:104: 00000100:00100000:0.0:1788482822.045748:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482822.045985:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072344064 00000100:00100000:0.0:1788482822.046681:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086e93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482822.046746:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072344064 00000100:00100000:1.0:1788482822.046808:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788482822.046829:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5823:x1875360072344064:12345-0@lo:104: 00010000:00010000:1.0:1788482822.046850:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb901493600/0x42820277aad788f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.046973:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788482822.046982:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5823:x1875360072344064:12345-0@lo:104: Request processed in 155us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482822.046992:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788482822.047026:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875360072344064:0@lo:104: 00010000:00010000:1.0:1788482822.047028:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482822.047067:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.047424:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb901493600/0x42820277aad788f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.047433:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482822.047438:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493600/0x42820277aad788f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.047466:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb901493600/0x42820277aad788f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482822.047474:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493600/0x42820277aad788f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482822.047480:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482822.047522:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb901493600/0x42820277aad788f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.047529:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482822.047564:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb901493600/0x42820277aad788f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.047571:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb901493600/0x42820277aad788f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.047596:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482822.047598:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482822.047600:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482822.047608:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072344192:0@lo:103: 00000100:00100000:2.0:1788482822.047668:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482822.048622:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072344192 00000100:00100000:1.0:1788482822.048633:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072344192 00010000:00010000:1.0:1788482822.048668:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb94204a400/0x42820277aad78900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad788f9 expref: 14 pid: 5801 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482822.048705:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788482822.048718:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:3277:x1875360072344192:12345-0@lo:103: 00010000:00010000:1.0:1788482822.048734:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482822.048740:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb94204a400/0x42820277aad78900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad788f9 expref: 14 pid: 5801 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048770:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb94204a400/0x42820277aad78900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad788f9 expref: 14 pid: 5801 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048788:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb94204a400/0x42820277aad78900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad788f9 expref: 14 pid: 5801 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048809:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048834:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788482822.048852:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003362542s 00010000:00010000:1.0:1788482822.048858:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048866:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048881:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048887:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048893:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900031400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788482822.048898:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048906:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048938:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482822.048950:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482822.049058:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3277:x1875360072344192:12345-0@lo:103: Request processed in 342us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482822.049066:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788482822.049245:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072344192:0@lo:103: 00010000:00010000:2.0:1788482822.050284:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482822.050319:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482822.050327:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900031400/0x42820277aad789a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482822.060161:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:6657:x1875360072343936:12345-0@lo:253: Request processed in 70320us (70409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482822.060188:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788482822.060369:0:6657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6657:1875360072343936:0@lo:253: 10000000:01000000:3.0:1788482822.060388:0:6657:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788482822.060411:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788482822.060414:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788482822.060415:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482822.060416:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482822.060418:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482822.060419:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482822.060421:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482822.060423:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482822.060424:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482822.060426:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482822.060428:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788482822.060450:0:6657:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788482822.067810:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788482822.068469:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788482822.068738:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788482822.069233:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788482822.069799:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788482822.070475:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788482822.071725:0:6657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788482822.339517:0:6657:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788482822.339531:0:6657:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788482822.339641:0:6657:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788482822.339758:0:6657:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788482822.339779:0:6657:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788482822.339862:0:6657:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788482823.026755:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482824.050353:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482825.076846:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482826.098785:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482827.126371:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482827.187667:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072344448:0@lo:400: 00000100:00100000:0.0:1788482827.187777:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482827.187860:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482827.187868:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072344576:0@lo:400: 00000100:00100000:0.0:1788482827.187898:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482827.187955:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072344448 00000100:00100000:0.0:1788482827.187966:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072344448 00000100:00100000:1.0:1788482827.187992:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072344320:0@lo:400: 00000100:00100000:0.0:1788482827.188020:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072344576 00000100:00100000:0.0:1788482827.188024:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072344576 00000100:00100000:1.0:1788482827.188032:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482827.188058:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788482827.188069:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072344448:12345-0@lo:400: 00000100:00100000:1.0:1788482827.188087:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788482827.188098:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788482827.188117:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072344320 00000100:00100000:1.0:1788482827.188120:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072344320 00000100:00100000:0.0:1788482827.188130:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072344448:12345-0@lo:400: Request processed in 63us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482827.188136:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788482827.188147:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788482827.188153:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3278:x1875360072344320:12345-0@lo:400: 00000100:00100000:0.0:1788482827.188155:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482827.188160:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072344576:12345-0@lo:400: 00000100:00100000:0.0:1788482827.188182:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072344576:12345-0@lo:400: Request processed in 21us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482827.188184:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3278:x1875360072344320:12345-0@lo:400: Request processed in 32us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482827.188188:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788482827.188189:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788482827.188207:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788482827.188239:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec5a300 x1875360072344576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482827.188294:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072344576:0@lo:400: 00010000:00080000:0.0:1788482827.188307:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec59880 x1875360072344448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482827.188315:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072344448:0@lo:400: 00000100:00100000:1.0:1788482827.188641:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072344320:0@lo:400: 00010000:00010000:3.0:1788482828.150596:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788482828.210327:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788482828.210338:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb9070c3000 from 21 10000000:01000000:0.0:1788482828.210346:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788482828.210423:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.210437:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.210453:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482828.210494:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072344704:0@lo:101: 00000100:00100000:0.0:1788482828.210605:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.210681:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482828.211427:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072344704 00000100:00100000:2.0:1788482828.211440:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072344704 00000100:00100000:2.0:1788482828.211526:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788482828.211540:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072344704:12345-0@lo:101: 00010000:00010000:2.0:1788482828.211561:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482828.211583:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad789a8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482828.211620:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad789a8 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482828.211633:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad789a8 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482828.211645:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d2a00, rc 0) 00000100:00100000:2.0:1788482828.211723:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072344704:12345-0@lo:101: Request processed in 186us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482828.211731:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788482828.212076:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072344704:0@lo:101: 00010000:00010000:0.0:1788482828.212104:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.212117:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482828.212428:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072344832:0@lo:501: 00000100:00100000:0.0:1788482828.212591:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.212641:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482828.212726:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072344832 00000100:00100000:2.0:1788482828.212733:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072344832 00000100:00100000:2.0:1788482828.212872:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788482828.212882:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072344832:12345-0@lo:501: 00000100:00100000:2.0:1788482828.213649:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072344832:12345-0@lo:501: Request processed in 765us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482828.213660:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788482828.214066:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072344832:0@lo:501: 00000100:00100000:0.0:1788482828.214119:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072344960:0@lo:503: 00000100:00100000:0.0:1788482828.214327:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.214370:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482828.214485:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072344960 00000100:00100000:3.0:1788482828.214493:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072344960 00000100:00100000:3.0:1788482828.214530:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788482828.214541:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072344960:12345-0@lo:503: 00000100:00100000:3.0:1788482828.214960:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072344960:12345-0@lo:503: Request processed in 419us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482828.214969:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788482828.215424:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072344960:0@lo:503: 00000100:00100000:0.0:1788482828.226107:0:6971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6971:1875360072345088:0@lo:502: 00000100:00100000:0.0:1788482828.226454:0:6971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.226547:0:6971:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482828.230776:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072345088 00000100:00100000:1.0:1788482828.230807:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072345088 00000100:00100000:1.0:1788482828.230926:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788482828.230940:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6971:x1875360072345088:12345-0@lo:502: 00000100:00100000:1.0:1788482828.231949:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6971:x1875360072345088:12345-0@lo:502: Request processed in 1004us (5489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482828.231976:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788482828.232174:0:6971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6971:1875360072345088:0@lo:502: 00000100:00100000:0.0:1788482828.232298:0:6971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6971:1875360072345216:0@lo:502: 00000100:00100000:0.0:1788482828.232354:0:6971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.232397:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072345216 00000100:00100000:0.0:1788482828.232404:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072345216 00000100:00100000:1.0:1788482828.232665:0:6971:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482828.232750:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788482828.232763:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6971:x1875360072345216:12345-0@lo:502: 00000100:00100000:0.0:1788482828.233106:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:6971:x1875360072345216:12345-0@lo:502: Request processed in 344us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482828.233114:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788482828.233635:0:6971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6971:1875360072345216:0@lo:502: 00000040:00080000:1.0:1788482828.233671:0:6971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788482828.234451:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788482828.234496:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788482828.234510:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.234548:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482828.234562:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788482828.234566:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eb9070c3000 from 4 10000000:01000000:0.0:1788482828.234570:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788482828.234629:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.234639:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.234652:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482828.234687:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345344:0@lo:101: 00000100:00100000:0.0:1788482828.234791:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.234852:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebe300 going to sleep for 11 seconds 00000100:00100000:1.0:1788482828.235502:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072345344 00000100:00100000:1.0:1788482828.235515:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072345344 00000100:00100000:1.0:1788482828.235587:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788482828.235599:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072345344:12345-0@lo:101: 00010000:00010000:1.0:1788482828.235619:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482828.235641:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad789b6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482828.235676:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad789b6 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482828.235689:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad789b6 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482828.235701:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb94204a400, rc 0) 00000100:00100000:1.0:1788482828.235885:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072345344:12345-0@lo:101: Request processed in 287us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482828.235893:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788482828.236400:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345344:0@lo:101: 00010000:00010000:0.0:1788482828.236423:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.236437:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482828.236613:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345472:0@lo:256: 00000100:00100000:0.0:1788482828.236678:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.236745:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebe300 going to sleep for 11 seconds 00000100:00100000:1.0:1788482828.236912:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072345472 00000100:00100000:1.0:1788482828.236920:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072345472 00000100:00100000:1.0:1788482828.236967:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788482828.236986:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072345472:12345-0@lo:256: 20000000:01000000:1.0:1788482828.237006:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788482828.237033:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788482828.237036:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788482828.237132:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072345472:12345-0@lo:256: Request processed in 156us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482828.237287:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788482828.237876:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345472:0@lo:256: 10000000:01000000:0.0:1788482828.237934:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788482828.237944:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.237953:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482828.237964:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788482828.237966:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788482828.237969:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788482828.238062:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.238069:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.238080:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482828.238101:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345600:0@lo:101: 00000100:00100000:0.0:1788482828.238754:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.238832:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebe300 going to sleep for 11 seconds 00000100:00100000:3.0:1788482828.238992:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072345600 00000100:00100000:3.0:1788482828.239004:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072345600 00000100:00100000:3.0:1788482828.239088:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788482828.239102:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072345600:12345-0@lo:101: 00010000:00010000:3.0:1788482828.239118:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482828.239146:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad789c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482828.239176:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad789c4 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482828.239187:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad789c4 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482828.239197:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492e00, rc 0) 00000100:00100000:3.0:1788482828.239270:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072345600:12345-0@lo:101: Request processed in 152us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482828.239277:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788482828.239835:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345600:0@lo:101: 00010000:00010000:0.0:1788482828.239856:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482828.239865:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482828.239949:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345728:0@lo:501: 00000100:00100000:0.0:1788482828.240088:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.240143:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebe300 going to sleep for 11 seconds 00000100:00100000:3.0:1788482828.242355:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072345728 00000100:00100000:3.0:1788482828.242372:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072345728 00000100:00100000:3.0:1788482828.242464:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788482828.242475:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072345728:12345-0@lo:501: 00000100:00100000:3.0:1788482828.242959:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072345728:12345-0@lo:501: Request processed in 485us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482828.242966:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788482828.243154:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345728:0@lo:501: 00000100:00100000:0.0:1788482828.243215:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345856:0@lo:503: 00000100:00100000:0.0:1788482828.243293:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.243330:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937ebe300 going to sleep for 11 seconds 00000100:00100000:0.0:1788482828.243345:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072345856 00000100:00100000:0.0:1788482828.243349:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072345856 00000100:00100000:0.0:1788482828.243928:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788482828.243938:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072345856:12345-0@lo:503: 00000100:00100000:0.0:1788482828.244756:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072345856:12345-0@lo:503: Request processed in 815us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482828.244821:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788482828.244894:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072345856:0@lo:503: 00000100:00100000:3.0:1788482828.246612:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6972:1875360072345984:0@lo:502: 00000100:00100000:3.0:1788482828.246698:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482828.246841:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072345984 00000100:00100000:1.0:1788482828.246850:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072345984 00000100:00100000:1.0:1788482828.246896:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788482828.246906:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:6972:x1875360072345984:12345-0@lo:502: 00000100:00100000:3.0:1788482828.247858:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788482828.248379:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:6972:x1875360072345984:12345-0@lo:502: Request processed in 1469us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482828.248391:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788482828.248884:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6972:1875360072345984:0@lo:502: 00000020:01000000:3.0:1788482828.248925:0:6972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788482828.248946:0:6972:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788482828.248956:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482828.248958:0:6972:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788482828.248963:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788482828.248967:0:6972:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1788482828.249552:0:6972:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788482828.249557:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788482828.249575:0:6972:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9eb93f648000) 00000020:00000080:3.0:1788482828.249598:0:6972:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788482828.249602:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788482828.249690:0:6972:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788482828.249695:0:6972:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788482828.249700:0:6972:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad789d9 00010000:00080000:3.0:1788482828.249752:0:6972:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb908622000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788482828.255613:0:6972:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788482828.351450:0:6972:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788482828.351499:0:6972:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788482828.352570:0:6972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788482828.353143:0:6972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788482828.353212:0:6972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788482828.353316:0:6972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788482828.354736:0:6977:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788482828.354745:0:6977:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788482828.355732:0:6972:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788482828.355749:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788482828.355858:0:6972:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788482828.355890:0:6972:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad789e0 00000100:00080000:3.0:1788482828.355907:0:6972:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788482828.355916:0:6972:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eb908622000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788482828.356034:0:6972:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9406f4700 x1875360072346112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788482828.356079:0:6972:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788482828.356316:0:6972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482828.356321:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482828.356324:0:6972:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788482828.356327:0:6972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482828.356332:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482828.356333:0:6972:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788482828.356335:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788482828.356338:0:6972:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788482828.356374:0:6972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6972:1875360072346240:0@lo:502: 00000100:00100000:3.0:1788482828.356491:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482828.356557:0:6972:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482828.356589:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072346240 00000100:00100000:3.0:1788482828.356597:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072346240 00000100:00100000:3.0:1788482828.356647:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788482828.356657:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:6972:x1875360072346240:12345-0@lo:502: 00000100:00100000:3.0:1788482828.357224:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:6972:x1875360072346240:12345-0@lo:502: Request processed in 565us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482828.357233:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788482828.357336:0:6972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:6972:1875360072346240:0@lo:502: 00000020:01000000:3.0:1788482828.357368:0:6972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482828.357373:0:6972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482828.357376:0:6972:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788482828.357380:0:6972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788482828.357562:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072346112:0@lo:8: 00000100:00100000:1.0:1788482828.357610:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788482828.357832:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788482828.357862:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788482828.357875:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482828.357905:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482828.357919:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788482828.357922:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eb920884d28 from 1 10000000:01000000:3.0:1788482828.357926:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788482828.358041:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482828.358051:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482828.358063:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482828.358082:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072346368:0@lo:101: 00000100:00100000:3.0:1788482828.358122:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482828.358280:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482828.358305:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072346112 00000100:00100000:3.0:1788482828.358312:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072346112 00000100:00100000:3.0:1788482828.358348:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482828.358357:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3276:x1875360072346112:12345-0@lo:8: 00010000:00080000:3.0:1788482828.358387:0:6660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:3.0:1788482828.358422:0:6660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad789ee 00002000:00100000:3.0:1788482828.358558:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9eb9056f5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788482828.358565:0:6660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788482828.358571:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788482828.358839:0:6660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788482828.363302:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788482828.363357:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb9056f6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788482828.363633:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3276:x1875360072346112:12345-0@lo:8: Request processed in 5272us (6019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482828.363647:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788482828.363763:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb9406f4700 x1875360072346112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788482838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482828.363851:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482828.363865:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788482828.363879:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788482828.363885:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788482828.363888:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb908622000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788482828.363900:0:3276:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788482828.363906:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072346112:0@lo:8: 00000004:00080000:3.0:1788482828.364381:0:6977:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788482828.364584:0:6977:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 145530333564ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788482828.364804:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072346496:0@lo:400: 00000100:00100000:2.0:1788482828.364905:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482828.365286:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072346496 00000100:00100000:2.0:1788482828.365297:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072346496 00000100:00100000:2.0:1788482828.365358:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788482828.365369:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072346496:12345-0@lo:400: 00000100:00100000:2.0:1788482828.365431:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072346496:12345-0@lo:400: Request processed in 63us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482828.365439:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788482828.365875:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb920894000 x1875360072346496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482828.365892:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072346496:0@lo:400: 00000100:00100000:2.0:1788482828.366033:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072346624:0@lo:400: 00000100:00100000:2.0:1788482828.366082:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482828.366210:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072346624 00000100:00100000:2.0:1788482828.366216:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072346624 00000100:00100000:2.0:1788482828.366269:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788482828.366276:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072346624:12345-0@lo:400: 00000100:00100000:2.0:1788482828.366318:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072346624:12345-0@lo:400: Request processed in 42us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482828.366324:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788482828.366373:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb920894000 x1875360072346624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482828.366384:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072346624:0@lo:400: 00000100:00100000:1.0:1788482828.366535:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072346368 00000100:00100000:1.0:1788482828.366541:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072346368 00000100:00100000:1.0:1788482828.366575:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788482828.366582:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072346368:12345-0@lo:101: 00010000:00010000:1.0:1788482828.366596:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482828.366620:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad789e7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482828.366650:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad789e7 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482828.366663:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad789e7 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482828.366674:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb94204b400, rc 0) 00000100:00100000:1.0:1788482828.366730:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072346368:12345-0@lo:101: Request processed in 149us (8607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482828.366735:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788482828.367199:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072346368:0@lo:101: 00010000:00010000:3.0:1788482828.367226:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482828.367238:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482828.367338:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072346752:0@lo:501: 00000100:00100000:3.0:1788482828.367380:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482828.367418:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482828.367451:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072346752 00000100:00100000:3.0:1788482828.368018:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072346752 00000100:00100000:3.0:1788482828.368120:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788482828.368142:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072346752:12345-0@lo:501: 00000100:00100000:3.0:1788482828.368714:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072346752:12345-0@lo:501: Request processed in 573us (1324us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788482828.368723:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788482828.373119:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072346752:0@lo:501: 10000000:01000000:2.0:1788482828.373354:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788482828.373367:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482828.373380:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788482828.491055:0:6978:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788482828.491111:0:6978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875360072347008:0@lo:7: 00000100:00100000:0.0:1788482828.491229:0:6978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.491647:0:6978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9c00 going to sleep for 11 seconds 00000004:00080000:0.0:1788482828.491676:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788482828.491739:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072346880:0@lo:13: 00000100:00100000:0.0:1788482828.491778:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.491841:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072347008 00000100:00100000:0.0:1788482828.491852:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072347008 00000100:00100000:0.0:1788482828.491941:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482828.491955:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6978:x1875360072347008:12345-0@lo:7: 00000100:00100000:1.0:1788482828.496348:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072346880 00000100:00100000:1.0:1788482828.496367:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072346880 00000100:00100000:1.0:1788482828.496644:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788482828.496659:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072346880:12345-0@lo:13: 00002000:00000024:1.0:1788482828.496721:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788482828.496862:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072346880:12345-0@lo:13: Request processed in 206us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482828.496870:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788482828.497112:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec5a300 x1875360072346880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482828.497141:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072346880:0@lo:13: 00000100:00080000:1.0:1788482828.498170:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788482828.511463:0:6663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788482828.511477:0:6663:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788482828.511775:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6978:x1875360072347008:12345-0@lo:7: Request processed in 19813us (20537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482828.511793:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788482828.511922:0:6978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec59500 x1875360072347008/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788482844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482828.512028:0:6978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875360072347008:0@lo:7: 00000004:00080000:0.0:1788482828.512057:0:6978:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788482828.512134:0:6978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875360072347136:0@lo:5: 00000100:00100000:0.0:1788482828.512189:0:6978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.512335:0:6978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482828.512438:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072347136 00000100:00100000:3.0:1788482828.512447:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072347136 00000100:00100000:3.0:1788482828.512543:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482828.512555:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6978:x1875360072347136:12345-0@lo:5: 00002000:00080000:3.0:1788482828.512610:0:6662:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788482828.512616:0:6662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788482828.513332:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6978:x1875360072347136:12345-0@lo:5: Request processed in 776us (1141us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788482828.513344:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788482828.513458:0:6978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec59500 x1875360072347136/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482828.513478:0:6978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875360072347136:0@lo:5: 00000004:00080000:0.0:1788482828.513496:0:6978:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788482828.513540:0:6978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875360072347264:0@lo:700: 00000100:00100000:0.0:1788482828.513638:0:6978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482828.513699:0:6978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788482828.513778:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072347264 00000100:00100000:2.0:1788482828.513786:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072347264 00000100:00100000:2.0:1788482828.513902:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482828.513914:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6978:x1875360072347264:12345-0@lo:700: 00000100:00100000:2.0:1788482828.514032:0:6669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6669:1875360072347392:0@lo:700: 00000100:00100000:2.0:1788482828.514069:0:6669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482828.514098:0:6669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482828.514155:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072347392 00000100:00100000:0.0:1788482828.514159:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072347392 00000100:00100000:0.0:1788482828.514202:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788482828.514210:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6669:x1875360072347392:12345-0@lo:700: 40000000:02000000:2.0:1788482828.554176:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788482828.563894:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6669:x1875360072347392:12345-0@lo:700: Request processed in 49664us (49803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482828.563928:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788482828.565626:0:6669:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb920894000 x1875360072347392/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788482844 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482828.565650:0:6669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6669:1875360072347392:0@lo:700: 40000000:02000000:2.0:1788482828.565667:0:6669:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788482828.670536:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6978:x1875360072347264:12345-0@lo:700: Request processed in 156605us (156877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482828.670564:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1788482828.670628:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788482828.670642:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1788482828.670695:0:6978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec58a80 x1875360072347264/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788482844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482828.670728:0:6978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875360072347264:0@lo:700: 00000004:02000040:1.0:1788482828.697486:0:6978:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788482828.703375:0:6978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937265880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875360072347520:0@lo:5: 00000100:00100000:1.0:1788482828.703492:0:6978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482828.703670:0:6978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086e9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788482828.707538:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072347520 00000100:00100000:2.0:1788482828.707565:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072347520 00000100:00100000:2.0:1788482828.707884:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482828.707907:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6978:x1875360072347520:12345-0@lo:5: 00002000:00080000:2.0:1788482828.715134:0:6663:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788482828.715165:0:6663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788482828.720017:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6978:x1875360072347520:12345-0@lo:5: Request processed in 12021us (16434us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788482828.720038:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788482828.720428:0:6978:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb937265880 x1875360072347520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482844 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482828.720447:0:6978:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788482828.720476:0:6978:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9eb937265880 x1875360072347520/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482844 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482828.720492:0:6978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937265880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6978:1875360072347520:0@lo:5: 00000004:00080000:1.0:1788482828.720513:0:6978:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788482829.171432:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788482829.255949:0:7034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788482830.196648:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482831.219471:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482832.244051:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482833.266373:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482833.843535:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482833.843562:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072347648:0@lo:13: 00000100:00100000:1.0:1788482833.843639:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482833.843699:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072347648 00000100:00100000:1.0:1788482833.843705:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072347648 00000100:00100000:1.0:1788482833.843753:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482833.843762:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072347648:12345-0@lo:13: 00002000:00000024:1.0:1788482833.843794:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482833.843843:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072347648:12345-0@lo:13: Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482833.843851:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788482833.843871:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482833.845910:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482833.845933:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3280:1875360072348032:0@lo:400: 00000100:00100000:0.0:1788482833.845992:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482833.846042:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072347776:0@lo:400: 00000100:00100000:0.0:1788482833.846073:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482833.846104:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482833.846110:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072347904:0@lo:400: 00000100:00100000:0.0:1788482833.846132:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482833.846190:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072348032 00000100:00100000:0.0:1788482833.846196:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072348032 00000100:00100000:0.0:1788482833.846241:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072347904 00000100:00100000:0.0:1788482833.846244:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072347904 00000100:00100000:0.0:1788482833.846282:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482833.846291:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875360072348032:12345-0@lo:400: 00000100:00100000:0.0:1788482833.846337:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875360072348032:12345-0@lo:400: Request processed in 47us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482833.846344:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482833.846358:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482833.846364:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072347904:12345-0@lo:400: 00000100:00100000:0.0:1788482833.846394:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072347904:12345-0@lo:400: Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482833.846400:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482833.846418:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072347776 00000100:00100000:0.0:1788482833.846421:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072347776 00000100:00100000:0.0:1788482833.846444:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788482833.846450:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3277:x1875360072347776:12345-0@lo:400: 00000100:00100000:0.0:1788482833.846477:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3277:x1875360072347776:12345-0@lo:400: Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482833.846483:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788482833.846532:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec5a300 x1875360072348032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482833.846553:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3280:1875360072348032:0@lo:400: 00010000:00080000:0.0:1788482833.846582:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec58a80 x1875360072347904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482833.846591:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072347904:0@lo:400: 00000100:00100000:0.0:1788482833.846599:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072347776:0@lo:400: 00000100:00080000:0.0:1788482833.846631:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788482833.851012:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb937266a00 x1875360072347648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482833.851042:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072347648:0@lo:13: 00000001:00080000:1.0:1788482833.943560:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788482834.291744:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482835.314838:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482836.338436:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482837.373052:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482838.392141:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482838.963143:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072348544:0@lo:400: 00000100:00100000:3.0:1788482838.963240:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482838.963334:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482838.963341:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072348160:0@lo:400: 00000100:00100000:3.0:1788482838.963371:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482838.963404:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072348288:0@lo:400: 00000100:00100000:3.0:1788482838.963431:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482838.963452:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482838.963458:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072348416:0@lo:400: 00000100:00100000:3.0:1788482838.963480:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482838.963513:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072348544 00000100:00100000:3.0:1788482838.963531:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072348544 00000100:00100000:3.0:1788482838.963668:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482838.963679:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072348544:12345-0@lo:400: 00000100:00100000:3.0:1788482838.963741:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072348544:12345-0@lo:400: Request processed in 64us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482838.963826:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482838.963855:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072348288 00000100:00100000:3.0:1788482838.963859:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072348288 00000100:00100000:3.0:1788482838.963884:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072348416 00000100:00100000:3.0:1788482838.963888:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072348416 00000100:00100000:3.0:1788482838.963910:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788482838.963917:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072348288:12345-0@lo:400: 00000100:00100000:3.0:1788482838.963953:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072348288:12345-0@lo:400: Request processed in 37us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482838.963959:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788482838.963970:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482838.963975:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072348416:12345-0@lo:400: 00000100:00100000:3.0:1788482838.964013:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072348416:12345-0@lo:400: Request processed in 38us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482838.964019:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788482838.964039:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482838.964043:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788482838.964077:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb9406f7480 x1875360072348416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482838.964092:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072348416:0@lo:400: 00010000:00080000:3.0:1788482838.964103:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb9406f5c00 x1875360072348288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482838.964111:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072348288:0@lo:400: 00010000:00080000:3.0:1788482838.964140:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb9406f4e00 x1875360072348544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482838.964148:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788482838.964159:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072348544:0@lo:400: 00000100:00100000:3.0:1788482838.964471:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788482838.964480:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072348672:0@lo:13: 00000100:00100000:3.0:1788482838.964510:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482838.965404:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072348160 00000100:00100000:2.0:1788482838.965413:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072348160 00000100:00100000:2.0:1788482838.965456:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788482838.965464:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3279:x1875360072348160:12345-0@lo:400: 00000100:00100000:2.0:1788482838.965536:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3279:x1875360072348160:12345-0@lo:400: Request processed in 73us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482838.965543:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788482838.965888:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072348160:0@lo:400: 00000100:00100000:1.0:1788482838.970160:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072348672 00000100:00100000:1.0:1788482838.970181:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072348672 00000100:00100000:1.0:1788482838.970320:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788482838.970335:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072348672:12345-0@lo:13: 00002000:00000024:1.0:1788482838.970388:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482838.970516:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072348672:12345-0@lo:13: Request processed in 187us (6005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482838.970535:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788482838.971134:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb937267480 x1875360072348672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482838.971165:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072348672:0@lo:13: 00010000:00010000:2.0:1788482839.411737:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482840.438615:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482841.458904:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788482841.562978:0:7604:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788482841.562984:0:7604:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788482841.563147:0:7604:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eb93f7bc000 00000020:01000004:2.0:1788482841.563169:0:7604:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788482841.563184:0:7604:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788482841.563202:0:7604:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9eb9030319b8) 00000020:00000080:2.0:1788482841.563221:0:7604:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788482841.583925:0:7604:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788482841.584210:0:7604:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788482841.616930:0:7604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788482841.624948:0:7604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788482841.624987:0:7604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788482841.625121:0:7604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788482841.625241:0:7604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788482841.625929:0:7604:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788482841.625944:0:7604:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788482841.625957:0:7604:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x42820277aad78a03 00000020:01000004:2.0:1788482841.625969:0:7604:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788482841.625997:0:7604:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788482841.626001:0:7604:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788482841.626008:0:7604:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788482841.626110:0:7604:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788482841.626115:0:7604:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788482841.661118:0:7604:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788482841.661175:0:7604:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788482841.661183:0:7604:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788482841.661185:0:7604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788482841.661186:0:7604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482841.661187:0:7604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482841.661189:0:7604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482841.661190:0:7604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482841.661192:0:7604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482841.661193:0:7604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482841.661195:0:7604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482841.661196:0:7604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482841.661198:0:7604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788482841.661202:0:7604:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788482841.661205:0:7604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788482841.661206:0:7604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788482841.661207:0:7604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482841.661208:0:7604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482841.661209:0:7604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482841.661210:0:7604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482841.661211:0:7604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482841.661212:0:7604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482841.661212:0:7604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482841.661213:0:7604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482841.661214:0:7604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788482841.661337:0:7604:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788482841.661364:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072348800:0@lo:253: 00000100:00100000:3.0:1788482841.661485:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482841.661560:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91f1af600 going to sleep for 11 seconds 00000100:00100000:0.0:1788482841.661590:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072348800 00000100:00100000:0.0:1788482841.661600:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072348800 00000100:00100000:0.0:1788482841.661731:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788482841.661746:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:7604:x1875360072348800:12345-0@lo:253: 20000000:01000000:0.0:1788482841.661787:0:5802:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788482841.661793:0:5802:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788482841.661800:0:5802:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788482841.661805:0:5802:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788482841.663003:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482841.663302:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788482841.663318:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788482841.663362:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788482841.663370:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788482841.663400:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788482841.663450:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788482841.663868:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788482841.663892:0:5802:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:0.0:1788482841.663894:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788482841.663930:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788482841.663938:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788482841.663984:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788482841.663993:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1788482841.664026:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788482841.664036:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788482841.664070:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788482841.664138:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788482841.669952:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788482841.670002:0:5802:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:0.0:1788482841.670006:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788482841.670061:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788482841.670070:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788482841.670586:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788482841.670598:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1788482841.670639:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788482841.670694:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788482841.670760:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788482841.670803:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788482841.670834:0:5802:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788482841.670838:0:5802:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788482841.670844:0:5802:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788482841.670865:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788482841.670869:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788482841.670922:0:5802:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788482841.670925:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788482841.673402:0:7606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788482841.673542:0:7606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788482841.673609:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788482841.675050:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788482841.675495:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788482841.675532:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788482841.675570:0:5802:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788482841.675574:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788482841.677881:0:7607:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788482841.678018:0:7607:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788482841.678408:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788482841.679452:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788482841.679589:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788482841.679658:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788482841.679680:0:5802:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788482841.679685:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788482841.683621:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788482841.685842:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788482841.685902:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788482841.685997:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788482841.686017:0:5802:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788482841.686021:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788482841.694908:0:7609:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788482841.695497:0:7609:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788482841.695575:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788482841.706728:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788482841.706807:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788482841.706899:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788482841.706926:0:5802:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788482841.706928:0:5802:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788482841.706939:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788482841.706964:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707000:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78954 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707006:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad7897e expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707011:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad789a8 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707015:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad789c4 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707019:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad789e7 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707024:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707077:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad789e7 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707104:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad789e7 expref: 16 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.707123:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072348928:0@lo:104: 00000100:00100000:3.0:1788482841.707217:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.707296:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788482841.707315:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072348928 00000100:00100000:0.0:1788482841.707325:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072348928 00000100:00100000:0.0:1788482841.707435:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788482841.707439:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad789c4 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.707449:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad789c4 expref: 16 pid: 5802 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482841.707449:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9058d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5802:x1875360072348928:12345-0@lo:104: 00000100:00100000:3.0:1788482841.707465:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072349056:0@lo:104: 00010000:00010000:0.0:1788482841.707483:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.707499:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482841.707548:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482841.707554:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9058d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5802:x1875360072348928:12345-0@lo:104: Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.707562:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788482841.707662:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482841.707670:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.707679:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492600 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788482841.707683:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.707691:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482841.707708:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482841.707714:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482841.707753:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.707767:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482841.707791:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.707798:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb901492600/0x42820277aad789e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.707814:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482841.707815:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482841.707817:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482841.707843:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072349184:0@lo:103: 00000100:00100000:2.0:1788482841.707878:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482841.707926:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072349184 00000100:00100000:2.0:1788482841.707930:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072349184 00010000:00010000:2.0:1788482841.707954:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad789e7 expref: 17 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482841.707977:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788482841.707984:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3277:x1875360072349184:12345-0@lo:103: 00010000:00010000:2.0:1788482841.707995:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482841.708000:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad789e7 expref: 17 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.708010:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad789e7 expref: 17 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.708038:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482841.708075:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3277:x1875360072349184:12345-0@lo:103: Request processed in 92us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482841.708091:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788482841.708153:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072349184:0@lo:103: 00010000:00010000:3.0:1788482841.708516:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad789a8 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.708527:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad789a8 expref: 16 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.708538:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072349312:0@lo:104: 00000100:00100000:3.0:1788482841.708566:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.708631:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072349056 00000100:00100000:0.0:1788482841.708638:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072349056 00000100:00100000:0.0:1788482841.708663:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788482841.708670:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5802:x1875360072349056:12345-0@lo:104: 00010000:00010000:0.0:1788482841.708680:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.708838:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482841.708845:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5802:x1875360072349056:12345-0@lo:104: Request processed in 176us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.708853:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788482841.709154:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482841.709162:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.709171:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900031000 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788482841.709175:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.709183:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482841.709190:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482841.709196:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788482841.709299:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.709306:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482841.709323:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.709330:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad789c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.709346:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482841.709348:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482841.709359:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482841.709366:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482841.709379:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072349440:0@lo:103: 00000100:00100000:2.0:1788482841.709413:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482841.709459:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072349440 00000100:00100000:2.0:1788482841.709483:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072349440 00010000:00010000:2.0:1788482841.709505:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad789c4 expref: 17 pid: 5802 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482841.709529:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788482841.709536:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3277:x1875360072349440:12345-0@lo:103: 00010000:00010000:2.0:1788482841.709547:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482841.709552:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad789c4 expref: 17 pid: 5802 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.709563:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad789c4 expref: 17 pid: 5802 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.709579:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482841.709608:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3277:x1875360072349440:12345-0@lo:103: Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482841.709615:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788482841.709653:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072349440:0@lo:103: 00000100:00100000:0.0:1788482841.710870:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072349312 00000100:00100000:0.0:1788482841.710885:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072349312 00010000:00010000:3.0:1788482841.710908:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad7897e expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.710923:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad7897e expref: 16 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.710936:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072349568:0@lo:104: 00000100:00100000:0.0:1788482841.710939:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482841.710947:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5802:x1875360072349312:12345-0@lo:104: 00010000:00010000:0.0:1788482841.710960:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.710985:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788482841.711004:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78954 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711011:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788482841.711012:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78954 expref: 16 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482841.711017:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5802:x1875360072349312:12345-0@lo:104: Request processed in 71us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.711021:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072349696:0@lo:104: 00000100:00100000:0.0:1788482841.711033:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482841.711055:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072349568 00000100:00100000:0.0:1788482841.711067:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072349568 00000100:00100000:3.0:1788482841.711068:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482841.711079:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91f1af540 going to sleep for 11 seconds 00000100:00100000:0.0:1788482841.711079:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072349696 00000100:00100000:0.0:1788482841.711081:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072349696 00000100:00100000:0.0:1788482841.711094:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788482841.711099:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:5802:x1875360072349568:12345-0@lo:104: 00010000:00010000:0.0:1788482841.711107:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.711113:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb94204b400/0x42820277aad789f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad789e7 expref: 16 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.711136:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072348928:0@lo:104: 00010000:00010000:0.0:1788482841.711140:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788482841.711144:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:5802:x1875360072349568:12345-0@lo:104: Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.711159:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788482841.711161:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492e00/0x42820277aad789cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad789c4 expref: 15 pid: 5802 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.711170:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072349056:0@lo:104: 00000100:00100000:0.0:1788482841.711174:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788482841.711179:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072349312:0@lo:104: 00000100:00100000:0.0:1788482841.711180:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5802:x1875360072349696:12345-0@lo:104: 00000100:00100000:3.0:1788482841.711185:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072349568:0@lo:104: 00010000:00010000:0.0:1788482841.711188:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711232:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788482841.711237:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5802:x1875360072349696:12345-0@lo:104: Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.711244:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788482841.711288:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788482841.711294:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711302:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900030600 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788482841.711306:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711315:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482841.711322:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482841.711328:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482841.711359:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711365:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482841.711392:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711399:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb900030600/0x42820277aad789a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711411:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788482841.711414:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711420:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204a200 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788482841.711423:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711430:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482841.711436:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482841.711442:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482841.711456:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711484:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482841.711490:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711497:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204a200/0x42820277aad7897e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78985 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.711504:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5802:1875360072349696:0@lo:104: 00010000:00010000:0.0:1788482841.711506:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482841.711514:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711519:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493000 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788482841.711522:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711529:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.711533:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482841.711534:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482841.711540:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482841.711566:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711573:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482841.711598:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711605:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad7895b expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711620:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482841.711622:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482841.711624:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482841.711639:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072349824:0@lo:103: 00000100:00100000:0.0:1788482841.711671:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.711693:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482841.711711:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072349952:0@lo:103: 00000100:00100000:0.0:1788482841.711739:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.711773:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072349824 00000100:00100000:0.0:1788482841.711779:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072349824 00010000:00010000:0.0:1788482841.711797:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad789a8 expref: 15 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482841.711818:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072349952 00000100:00100000:0.0:1788482841.711821:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072349952 00010000:00010000:0.0:1788482841.711831:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad7897e expref: 16 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482841.711843:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482841.711850:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3279:x1875360072349824:12345-0@lo:103: 00010000:00010000:0.0:1788482841.711862:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482841.711869:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad789a8 expref: 16 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711880:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad789a8 expref: 16 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711893:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d2a00/0x42820277aad789af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad789a8 expref: 16 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711906:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482841.711935:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:3279:x1875360072349824:12345-0@lo:103: Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.711942:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788482841.711956:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788482841.711962:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:3279:x1875360072349952:12345-0@lo:103: 00010000:00010000:0.0:1788482841.711970:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482841.711981:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad7897e expref: 14 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711989:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad7897e expref: 14 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.711998:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492400/0x42820277aad78985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad7897e expref: 14 pid: 5801 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.712010:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482841.712033:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3279:x1875360072349952:12345-0@lo:103: Request processed in 72us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.712040:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788482841.712063:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072350080:0@lo:103: 00000100:00100000:0.0:1788482841.712077:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072349952:0@lo:103: 00000100:00100000:0.0:1788482841.712085:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072349824:0@lo:103: 00000100:00100000:3.0:1788482841.712103:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788482841.712242:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482841.712830:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072350080 00000100:00100000:0.0:1788482841.712840:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072350080 00010000:00010000:0.0:1788482841.712873:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78954 expref: 13 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482841.712964:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788482841.712973:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3277:x1875360072350080:12345-0@lo:103: 00010000:00010000:0.0:1788482841.712986:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482841.712991:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78954 expref: 13 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713003:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78954 expref: 13 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713017:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901493800/0x42820277aad7895b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78954 expref: 13 pid: 5800 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713068:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713078:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713096:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713104:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713111:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713117:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713123:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788482841.713129:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713138:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713159:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.713170:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482841.713242:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3277:x1875360072350080:12345-0@lo:103: Request processed in 271us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.713281:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788482841.713365:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072350080:0@lo:103: 00010000:00010000:3.0:1788482841.713453:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.713481:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.713488:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901493a00/0x42820277aad78a0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788482841.713503:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788482841.797686:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:7604:x1875360072348800:12345-0@lo:253: Request processed in 135928us (136194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482841.797716:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788482841.797847:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072348800:0@lo:253: 10000000:01000000:3.0:1788482841.797863:0:7604:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788482841.797866:0:7604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788482841.797883:0:7604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788482841.797884:0:7604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482841.797885:0:7604:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788482841.797886:0:7604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482841.797887:0:7604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482841.797889:0:7604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482841.797890:0:7604:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788482841.797891:0:7604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482841.797892:0:7604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788482841.797914:0:7604:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eb93f7bc000 from lustre-OST0001 10000000:01000000:3.0:1788482841.797939:0:7604:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788482841.797941:0:7604:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788482841.797950:0:7604:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eb920884d28 local copy 10000000:01000000:3.0:1788482841.797955:0:7604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788482841.798007:0:7604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.798017:0:7604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.798025:0:7604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482841.798042:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350208:0@lo:101: 00000100:00100000:3.0:1788482841.798086:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482841.798165:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91f1afe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482841.798443:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072350208 00000100:00100000:2.0:1788482841.798450:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072350208 00000100:00100000:2.0:1788482841.798525:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788482841.798537:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+11:7604:x1875360072350208:12345-0@lo:101: 00010000:00010000:2.0:1788482841.798551:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482841.798565:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d2a00/0x42820277aad78a18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78a11 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.798589:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d2a00/0x42820277aad78a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78a11 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.798598:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d2a00/0x42820277aad78a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a11 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.798606:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d2a00, rc 0) 00000100:00100000:2.0:1788482841.798646:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:7604:x1875360072350208:12345-0@lo:101: Request processed in 113us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482841.798652:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788482841.798848:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350208:0@lo:101: 00010000:00010000:0.0:1788482841.798866:0:7604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.798876:0:7604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482841.799005:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350336:0@lo:501: 00000100:00100000:0.0:1788482841.799031:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.799059:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788482841.799113:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072350336 00000100:00100000:1.0:1788482841.799118:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072350336 00000100:00100000:1.0:1788482841.799160:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788482841.799168:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:7604:x1875360072350336:12345-0@lo:501: 00000100:00100000:1.0:1788482841.799434:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:7604:x1875360072350336:12345-0@lo:501: Request processed in 268us (402us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788482841.799440:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788482841.799481:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350336:0@lo:501: 10000000:01000000:1.0:1788482841.799497:0:7604:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788482841.799525:0:7604:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788482841.799531:0:7604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799540:0:7604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799545:0:7604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799566:0:7604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788482841.799593:0:7604:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eb93f7bc000 10000000:01000000:1.0:1788482841.799597:0:7604:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788482841.799602:0:7604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788482841.799603:0:7604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788482841.799606:0:7604:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788482841.799608:0:7604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788482841.799628:0:7604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799636:0:7604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799644:0:7604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482841.799656:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350464:0@lo:101: 00000100:00100000:1.0:1788482841.799712:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.799738:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482841.799751:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072350464 00000100:00100000:1.0:1788482841.799755:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072350464 00000100:00100000:1.0:1788482841.799774:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788482841.799780:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:7604:x1875360072350464:12345-0@lo:101: 00010000:00010000:1.0:1788482841.799788:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482841.799801:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78a1f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799819:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78a1f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799836:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a1f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799844:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb94204a200, rc 0) 00000100:00100000:1.0:1788482841.799870:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350464:12345-0@lo:101: Request processed in 90us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482841.799877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788482841.799905:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350464:0@lo:101: 00010000:00010000:1.0:1788482841.799914:0:7604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.799921:0:7604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482841.799994:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350592:0@lo:501: 00000100:00100000:1.0:1788482841.800021:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.800034:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482841.800047:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072350592 00000100:00100000:1.0:1788482841.800050:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072350592 00000100:00100000:1.0:1788482841.800069:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788482841.800074:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350592:12345-0@lo:501: 00000100:00100000:1.0:1788482841.800275:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350592:12345-0@lo:501: Request processed in 173us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482841.800283:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788482841.800317:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350592:0@lo:501: 00000100:00100000:1.0:1788482841.800348:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350720:0@lo:503: 00000100:00100000:1.0:1788482841.800392:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.800413:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482841.800425:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072350720 00000100:00100000:1.0:1788482841.800429:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072350720 00000100:00100000:1.0:1788482841.800447:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788482841.800452:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350720:12345-0@lo:503: 00000100:00100000:1.0:1788482841.800623:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350720:12345-0@lo:503: Request processed in 170us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482841.800631:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788482841.800669:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350720:0@lo:503: 00000040:00080000:1.0:1788482841.801007:0:7604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788482841.801077:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350848:0@lo:502: 00000100:00100000:1.0:1788482841.801116:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.801132:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482841.801148:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072350848 00000100:00100000:1.0:1788482841.801153:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072350848 00000100:00100000:1.0:1788482841.801176:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788482841.801184:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350848:12345-0@lo:502: 00000100:00100000:1.0:1788482841.801364:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350848:12345-0@lo:502: Request processed in 180us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482841.801371:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788482841.801530:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350848:0@lo:502: 00000040:00080000:1.0:1788482841.801727:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788482841.801759:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788482841.801777:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788482841.801801:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788482841.801820:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788482841.801847:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788482841.801866:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350976:0@lo:502: 00000100:00100000:1.0:1788482841.801895:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.801917:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482841.801928:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072350976 00000100:00100000:1.0:1788482841.801931:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072350976 00000100:00100000:1.0:1788482841.801948:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788482841.801952:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350976:12345-0@lo:502: 00000100:00100000:1.0:1788482841.802040:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072350976:12345-0@lo:502: Request processed in 87us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482841.802045:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788482841.802080:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072350976:0@lo:502: 00000040:00080000:1.0:1788482841.802156:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788482841.802165:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:0.0:1788482841.802832:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482841.802842:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.802851:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493a00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788482841.802855:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.802864:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482841.802870:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482841.802874:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788482841.802902:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.802916:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482841.802944:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.802948:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb901493a00/0x42820277aad78a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x42820277aad78a18 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.802960:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482841.802961:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482841.802962:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482841.803003:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482841.803017:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072351104:0@lo:103: 00000100:00100000:3.0:1788482841.803061:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.803161:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072351104 00000100:00100000:0.0:1788482841.803169:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072351104 00000100:00100000:0.0:1788482841.803225:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482841.803234:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3277:x1875360072351104:12345-0@lo:103: 00010000:00010000:0.0:1788482841.803284:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482841.803302:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d2a00/0x42820277aad78a18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78a11 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.803316:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482841.803345:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3277:x1875360072351104:12345-0@lo:103: Request processed in 114us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.803350:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788482841.803462:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072351104:0@lo:103: 00000020:01000000:0.0:1788482841.804606:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788482841.804619:0:7611:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788482841.804628:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482841.804631:0:7611:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788482841.804637:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788482841.804657:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9eb93f393370) 00000020:00000080:0.0:1788482841.804693:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788482841.804795:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788482841.804890:0:7611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb93f7bc000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788482841.804901:0:7611:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788482841.804912:0:7611:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x42820277aad78a34 00010000:00010000:0.0:1788482841.810084:0:7611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788482841.810904:0:7611:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788482841.813646:0:7611:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788482841.814066:0:7611:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788482841.820646:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788482841.821438:0:7611:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788482841.825278:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788482841.825297:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482841.825304:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482841.825307:0:7611:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788482841.825310:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482841.825315:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482841.825316:0:7611:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788482841.825319:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788482841.825321:0:7611:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788482841.825396:0:7611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482841.825400:0:7611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482841.825401:0:7611:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788482841.825404:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788482841.825907:0:7604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788482841.825948:0:7604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788482841.825975:0:7604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.825989:0:7604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482841.825999:0:7604:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb93f7bc000 from 1 10000000:01000000:1.0:1788482841.826002:0:7604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788482841.826070:0:7604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.826079:0:7604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.826092:0:7604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482841.826121:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351232:0@lo:101: 00000100:00100000:1.0:1788482841.826237:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.826329:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482841.826508:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072351232 00000100:00100000:3.0:1788482841.826520:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072351232 00000100:00100000:3.0:1788482841.826605:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788482841.826618:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:7604:x1875360072351232:12345-0@lo:101: 00010000:00010000:3.0:1788482841.826637:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482841.826653:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78a3b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.826684:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78a3b expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.826707:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a3b expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.826718:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492e00, rc 0) 00000100:00100000:3.0:1788482841.826769:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351232:12345-0@lo:101: Request processed in 154us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.826776:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788482841.826956:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351232:0@lo:101: 00010000:00010000:1.0:1788482841.826975:0:7604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.826984:0:7604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482841.827133:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351360:0@lo:501: 00000100:00100000:1.0:1788482841.827177:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.827205:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482841.827367:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072351360 00000100:00100000:3.0:1788482841.827372:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072351360 00000100:00100000:3.0:1788482841.827406:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788482841.827414:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351360:12345-0@lo:501: 00000100:00100000:3.0:1788482841.827851:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351360:12345-0@lo:501: Request processed in 436us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.827860:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788482841.828127:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351360:0@lo:501: 00000100:00100000:1.0:1788482841.828340:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351488:0@lo:503: 00000100:00100000:1.0:1788482841.828392:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.828432:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482841.828568:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072351488 00000100:00100000:3.0:1788482841.828574:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072351488 00000100:00100000:3.0:1788482841.828618:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788482841.828627:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351488:12345-0@lo:503: 00000100:00100000:3.0:1788482841.835013:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351488:12345-0@lo:503: Request processed in 6369us (6603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.835059:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788482841.835316:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351488:0@lo:503: 00000040:00080000:1.0:1788482841.835953:0:7604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788482841.836094:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351616:0@lo:502: 00000100:00100000:1.0:1788482841.836189:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.836243:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482841.836614:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072351616 00000100:00100000:3.0:1788482841.836625:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072351616 00000100:00100000:3.0:1788482841.836759:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788482841.836773:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351616:12345-0@lo:502: 00000100:00100000:3.0:1788482841.837092:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351616:12345-0@lo:502: Request processed in 322us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.837102:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788482841.840398:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351616:0@lo:502: 00000040:00080000:1.0:1788482841.840841:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788482841.840925:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788482841.840977:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351744:0@lo:502: 00000100:00100000:1.0:1788482841.841082:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.841141:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482841.842318:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072351744 00000100:00100000:3.0:1788482841.842342:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072351744 00000100:00100000:3.0:1788482841.842441:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788482841.842456:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351744:12345-0@lo:502: 00000100:00100000:3.0:1788482841.842966:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351744:12345-0@lo:502: Request processed in 513us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.842973:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788482841.844652:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351744:0@lo:502: 00000040:00080000:1.0:1788482841.844899:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788482841.844915:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788482841.847936:0:7615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482841.847953:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482841.847955:0:7615:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788482841.847964:0:7615:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb93f7bc000 00000020:00000080:3.0:1788482841.847965:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788482841.847983:0:7615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482841.847985:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482841.847986:0:7615:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788482841.847988:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788482841.848327:0:7604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788482841.848365:0:7604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788482841.848399:0:7604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.848416:0:7604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482841.851283:0:7604:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788482841.851294:0:7604:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eb93f7bc000 10000000:01000000:2.0:1788482841.851299:0:7604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eb93f7bc000 10000000:01000000:2.0:1788482841.851304:0:7604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788482841.851310:0:7604:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb93f7bc000 from 1 10000000:01000000:2.0:1788482841.851313:0:7604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788482841.851372:0:7604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.851386:0:7604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.851401:0:7604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482841.851434:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351872:0@lo:101: 00000100:00100000:2.0:1788482841.851535:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482841.851599:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066aaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482841.851739:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072351872 00000100:00100000:0.0:1788482841.851748:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072351872 00000100:00100000:0.0:1788482841.851798:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788482841.851806:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072351872:12345-0@lo:101: 00010000:00010000:0.0:1788482841.851819:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482841.851832:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78a49 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.851855:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78a49 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.851863:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a49 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.851880:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb900030600, rc 0) 00000100:00100000:0.0:1788482841.851926:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072351872:12345-0@lo:101: Request processed in 121us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.851931:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788482841.854685:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072351872:0@lo:101: 00010000:00010000:2.0:1788482841.854727:0:7604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.854738:0:7604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482841.854878:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072352000:0@lo:501: 00000100:00100000:2.0:1788482841.854940:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482841.854984:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066aaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482841.855185:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072352000 00000100:00100000:3.0:1788482841.855192:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072352000 00000100:00100000:3.0:1788482841.855443:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788482841.855453:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072352000:12345-0@lo:501: 00000100:00100000:3.0:1788482841.855911:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072352000:12345-0@lo:501: Request processed in 457us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.855922:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788482841.860873:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072352000:0@lo:501: 00000100:00100000:0.0:1788482841.862571:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072352128:0@lo:503: 00000100:00100000:0.0:1788482841.862703:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.862769:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788482841.862872:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072352128 00000100:00100000:2.0:1788482841.862885:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072352128 00000100:00100000:2.0:1788482841.862959:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788482841.862972:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072352128:12345-0@lo:503: 00000100:00100000:2.0:1788482841.863547:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072352128:12345-0@lo:503: Request processed in 574us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482841.863565:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788482841.863857:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072352128:0@lo:503: 00000040:00080000:0.0:1788482841.864622:0:7604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788482841.865965:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072352256:0@lo:502: 00000100:00100000:0.0:1788482841.866979:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.867870:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788482841.868292:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072352256 00000100:00100000:2.0:1788482841.868306:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072352256 00000100:00100000:2.0:1788482841.868376:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788482841.868389:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072352256:12345-0@lo:502: 00000100:00100000:3.0:1788482841.874905:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072352256:12345-0@lo:502: Request processed in 6501us (7915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.874927:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788482841.875273:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072352256:0@lo:502: 00000040:00080000:0.0:1788482841.875690:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788482841.875846:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788482841.875882:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788482841.875929:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788482841.875963:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788482841.876094:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788482841.876390:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788482841.876424:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788482841.876483:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788482841.876521:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788482841.876554:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788482841.876602:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788482841.876638:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788482841.876686:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788482841.876938:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788482841.876979:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788482841.877080:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788482841.877246:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788482841.877853:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788482841.877890:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788482841.877940:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788482841.877976:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788482841.878225:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788482841.878884:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788482841.878931:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788482841.878966:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788482841.879343:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788482841.879384:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788482841.879419:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788482841.879501:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788482841.879540:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788482841.879576:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788482841.879611:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788482841.879662:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788482841.880650:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788482841.880822:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788482841.880861:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788482841.880931:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072352384:0@lo:502: 00000100:00100000:0.0:1788482841.881242:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.881443:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788482841.881501:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072352384 00000100:00100000:3.0:1788482841.881513:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072352384 00000100:00100000:3.0:1788482841.881574:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788482841.881587:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072352384:12345-0@lo:502: 00000100:00100000:3.0:1788482841.881989:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072352384:12345-0@lo:502: Request processed in 403us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.882056:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788482841.882932:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072352384:0@lo:502: 00000040:00080000:0.0:1788482841.883091:0:7604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788482841.883113:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788482841.885020:0:7616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788482841.885042:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9eb93f3919b8) 00000020:00000080:0.0:1788482841.885086:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788482841.885659:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb93f7bc000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788482841.885666:0:7616:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb93f7bc000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788482841.885669:0:7616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb93f7bc000 3 00010000:00080000:0.0:1788482841.885712:0:7616:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb9293e1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1788482841.888413:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788482841.888686:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788482841.888734:0:7616:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788482841.888752:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x42820277aad78a5e 00000100:00080000:0.0:1788482841.888766:0:7616:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788482841.888773:0:7616:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eb9293e1800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788482841.888820:0:7616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb92ec58a80 x1875360072352512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788482841.888930:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3276:1875360072352512:0@lo:38: 00000100:00100000:3.0:1788482841.889028:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482841.889135:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072352512 00000100:00100000:2.0:1788482841.889145:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072352512 00000100:00080000:0.0:1788482841.889189:0:7616:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788482841.889196:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482841.889208:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3276:x1875360072352512:12345-0@lo:38: 00010000:00080000:2.0:1788482841.889276:0:5807:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:2.0:1788482841.889326:0:5807:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42820277aad78a65 00000004:00100000:2.0:1788482841.889343:0:5807:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788482841.889380:0:5807:0:(import.c:65:import_set_state_nolock()) ffff9eb937ddc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482841.889599:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788482841.889603:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072352640:0@lo:400: 00000100:00100000:0.0:1788482841.889610:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072352896:0@lo:400: 00000100:00100000:1.0:1788482841.889639:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.889641:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482841.889749:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072352896 00000100:00100000:0.0:1788482841.889754:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072352896 00000100:00100000:0.0:1788482841.889806:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788482841.889814:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072352896:12345-0@lo:400: 00000100:00100000:0.0:1788482841.889854:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072352896:12345-0@lo:400: Request processed in 41us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.889861:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788482841.889904:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb937266680 x1875360072352896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482841.889915:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875360072352512:12345-0@lo:38: Request processed in 709us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.889921:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072352896:0@lo:400: 00000100:00100000:2.0:1788482841.889926:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788482841.889944:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072352640 00000100:00100000:2.0:1788482841.889947:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072352640 00000100:00100000:2.0:1788482841.889972:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788482841.889977:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072352640:12345-0@lo:400: 00000100:00100000:2.0:1788482841.890003:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072352640:12345-0@lo:400: Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482841.890007:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788482841.890561:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92ec58a80 x1875360072352512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788482851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482841.890571:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482841.890580:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788482841.890591:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788482841.890596:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788482841.890600:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb9293e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788482841.890608:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3276:1875360072352512:0@lo:38: 00000100:00080000:3.0:1788482841.890641:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788482841.892925:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788482841.893796:0:7604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788482841.893870:0:7604:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788482841.893922:0:7604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482841.893938:0:7604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788482841.894005:0:7604:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788482841.894007:0:7604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788482841.894008:0:7604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482841.894010:0:7604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482841.894011:0:7604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482841.894013:0:7604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482841.894014:0:7604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482841.894016:0:7604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482841.894018:0:7604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482841.894020:0:7604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482841.894022:0:7604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788482841.894027:0:7604:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788482841.894030:0:7604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788482841.894032:0:7604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788482841.894033:0:7604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482841.894034:0:7604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482841.894035:0:7604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482841.894036:0:7604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482841.894037:0:7604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482841.894038:0:7604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482841.894039:0:7604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482841.894040:0:7604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482841.894041:0:7604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788482841.894079:0:7604:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788482841.894498:0:7604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072353024:0@lo:253: 00000100:00100000:3.0:1788482841.894612:0:7604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482841.894678:0:7604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb92ec86c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482841.894746:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072353024 00000100:00100000:0.0:1788482841.894757:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072353024 00000100:00100000:0.0:1788482841.894828:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1788482841.894841:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb937264e00 x1875360072352640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482841.894841:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7604:x1875360072353024:12345-0@lo:253: 00000100:00100000:1.0:1788482841.894859:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072352640:0@lo:400: 20000000:01000000:0.0:1788482841.894884:0:5800:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788482841.894906:0:5800:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788482841.894907:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482841.894914:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072352768:0@lo:400: 00000100:00100000:1.0:1788482841.894947:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.895008:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072352768 00000100:00100000:1.0:1788482841.895012:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072352768 00000100:00100000:1.0:1788482841.895060:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788482841.895066:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072352768:12345-0@lo:400: 00000100:00100000:1.0:1788482841.895121:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072352768:12345-0@lo:400: Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482841.895136:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788482841.895859:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788482841.895893:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb937265180 x1875360072352768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482841.895905:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072352768:0@lo:400: 00000100:00100000:2.0:1788482841.895931:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7617:1875360072353152:0@lo:901: 00000100:00100000:2.0:1788482841.895987:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482841.896021:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066aa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788482841.896208:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072353152 00000100:00100000:3.0:1788482841.896218:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072353152 00000100:00100000:3.0:1788482841.896377:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482841.896393:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7617:x1875360072353152:12345-0@lo:901: 00000100:00100000:3.0:1788482841.896778:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7617:x1875360072353152:12345-0@lo:901: Request processed in 385us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482841.896789:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788482841.896817:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788482841.896846:0:7617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb920896300 x1875360072353152/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788482857 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482841.896860:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7617:1875360072353152:0@lo:901: 20000000:01000000:1.0:1788482841.936288:0:5800:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788482841.936315:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788482841.936344:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788482841.936352:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788482841.936383:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.936541:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad789b6 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.936554:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.936846:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad789b6 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.936863:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad789b6 expref: 14 pid: 5802 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482841.936882:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920897b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875360072353280:0@lo:104: 00000100:00100000:2.0:1788482841.936973:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482841.937043:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086e9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788482841.937286:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072353280 00000100:00100000:0.0:1788482841.937297:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072353280 00000100:00100000:0.0:1788482841.937384:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788482841.937398:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5823:x1875360072353280:12345-0@lo:104: 00010000:00010000:0.0:1788482841.937424:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482841.937529:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788482841.937537:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:5823:x1875360072353280:12345-0@lo:104: Request processed in 143us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.937545:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788482841.937674:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482841.937684:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.937804:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900031800 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482841.937810:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.937822:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482841.937830:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482841.937836:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482841.937882:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.937888:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482841.937912:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.937942:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb900031800/0x42820277aad789b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad789bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.937966:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482841.937969:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482841.937970:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482841.937988:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072353408:0@lo:103: 00000100:00100000:1.0:1788482841.938034:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482841.938167:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072353408 00000100:00100000:1.0:1788482841.938171:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072353408 00010000:00010000:1.0:1788482841.938200:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad789b6 expref: 15 pid: 5802 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482841.938228:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788482841.938236:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:3278:x1875360072353408:12345-0@lo:103: 00010000:00010000:1.0:1788482841.938247:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482841.938268:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad789b6 expref: 15 pid: 5802 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938276:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad789b6 expref: 15 pid: 5802 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938294:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938300:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788482841.938315:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003362542s 00010000:00010000:1.0:1788482841.938326:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938334:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938342:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938348:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938354:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb9421d3600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788482841.938359:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938366:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938376:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482841.938386:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788482841.938572:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb94204a400/0x42820277aad789bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad789b6 expref: 15 pid: 5802 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482841.938588:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920897b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1875360072353280:0@lo:104: 00010000:00010000:2.0:1788482841.938609:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.938619:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.938626:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482841.938640:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482841.938853:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:3278:x1875360072353408:12345-0@lo:103: Request processed in 615us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482841.938861:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788482841.945612:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072353408:0@lo:103: 00000100:00100000:0.0:1788482841.959519:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:7604:x1875360072353024:12345-0@lo:253: Request processed in 64665us (64891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482841.959538:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788482841.960094:0:7604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7604:1875360072353024:0@lo:253: 10000000:01000000:3.0:1788482841.960118:0:7604:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788482841.960122:0:7604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788482841.960123:0:7604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788482841.960125:0:7604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788482841.960126:0:7604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788482841.960128:0:7604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788482841.960129:0:7604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788482841.960131:0:7604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788482841.960132:0:7604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788482841.960134:0:7604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788482841.960136:0:7604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788482841.960138:0:7604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788482841.960158:0:7604:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788482841.967703:0:7604:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788482841.967927:0:7604:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788482841.968141:0:7604:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788482841.968370:0:7604:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788482841.968596:0:7604:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788482841.968875:0:7604:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788482841.983520:0:7604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788482842.258040:0:7604:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788482842.258060:0:7604:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788482842.258107:0:7604:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788482842.258184:0:7604:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788482842.258202:0:7604:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788482842.258239:0:7604:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788482842.483538:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482843.506415:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482844.085335:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072353536:0@lo:13: 00000100:00100000:2.0:1788482844.085447:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482844.085576:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072353536 00000100:00100000:1.0:1788482844.085586:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072353536 00000100:00100000:1.0:1788482844.085669:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788482844.085681:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072353536:12345-0@lo:13: 00002000:00000024:1.0:1788482844.085730:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482844.085780:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072353536:12345-0@lo:13: Request processed in 101us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482844.085788:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788482844.085931:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788482844.085958:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937265880 x1875360072353536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482844.085983:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072353536:0@lo:13: 00010000:00010000:3.0:1788482844.537607:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482845.554470:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482846.590840:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482847.154946:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072353792:0@lo:400: 00000100:00100000:1.0:1788482847.155030:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.155108:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482847.155115:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072353920:0@lo:400: 00000100:00100000:1.0:1788482847.155138:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.155183:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072353792 00000100:00100000:1.0:1788482847.155192:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072353792 00000100:00100000:1.0:1788482847.155239:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072353920 00000100:00100000:1.0:1788482847.155242:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072353920 00000100:00100000:1.0:1788482847.155292:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788482847.155302:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072353792:12345-0@lo:400: 00000100:00100000:1.0:1788482847.155353:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072353792:12345-0@lo:400: Request processed in 52us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482847.155360:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788482847.155376:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788482847.155589:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072353664:0@lo:400: 00000100:00100000:2.0:1788482847.155639:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.155665:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072354176:0@lo:400: 00000100:00100000:2.0:1788482847.155687:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.155700:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788482847.155707:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072354048:0@lo:400: 00000100:00100000:2.0:1788482847.155731:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.155759:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072354048 00000100:00100000:2.0:1788482847.155763:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072354048 00000100:00100000:2.0:1788482847.155799:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788482847.155807:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072354048:12345-0@lo:400: 00000100:00100000:2.0:1788482847.155842:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072354048:12345-0@lo:400: Request processed in 37us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.155848:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788482847.155892:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937264380 x1875360072354048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482847.155909:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072354048:0@lo:400: 00000100:00100000:2.0:1788482847.155975:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072354176 00000100:00100000:2.0:1788482847.155994:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072354176 00010000:00080000:0.0:1788482847.156438:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937266a00 x1875360072353792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482847.156452:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072353792:0@lo:400: 00000100:00100000:0.0:1788482847.156626:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072353664 00000100:00100000:0.0:1788482847.156630:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072353664 00000100:00100000:0.0:1788482847.156661:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788482847.156668:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3280:x1875360072353664:12345-0@lo:400: 00000100:00100000:0.0:1788482847.156722:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3280:x1875360072353664:12345-0@lo:400: Request processed in 53us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482847.156729:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788482847.157182:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072353664:0@lo:400: 00000100:00100000:1.0:1788482847.163828:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072353920:12345-0@lo:400: 00000100:00100000:1.0:1788482847.163954:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072353920:12345-0@lo:400: Request processed in 151us (8813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.164065:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788482847.164076:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072354176:12345-0@lo:400: 00000100:00100000:2.0:1788482847.164119:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072354176:12345-0@lo:400: Request processed in 46us (8431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.164126:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788482847.166241:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788482847.166273:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788482847.169066:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937267b80 x1875360072353920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482847.169093:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072353920:0@lo:400: 00010000:00080000:0.0:1788482847.169146:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937266d80 x1875360072354176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482847.169157:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072354176:0@lo:400: 00000100:00100000:1.0:1788482847.172700:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788482847.605756:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788482847.667880:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788482847.667892:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb906309000 from 30 10000000:01000000:1.0:1788482847.667898:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482847.667955:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.667969:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.667993:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482847.668025:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072354304:0@lo:101: 00000100:00100000:1.0:1788482847.668117:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.668187:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.668428:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072354304 00000100:00100000:2.0:1788482847.668436:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072354304 00000100:00100000:2.0:1788482847.668485:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788482847.668494:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072354304:12345-0@lo:101: 00010000:00010000:2.0:1788482847.668507:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482847.668520:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78a73 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.668544:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78a73 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.668554:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a73 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.668563:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d3600, rc 0) 00000100:00100000:2.0:1788482847.668605:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072354304:12345-0@lo:101: Request processed in 113us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.668611:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788482847.669180:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072354304:0@lo:101: 00010000:00010000:1.0:1788482847.669200:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.669210:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482847.669312:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072354432:0@lo:501: 00000100:00100000:1.0:1788482847.669354:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.669399:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.669416:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072354432 00000100:00100000:1.0:1788482847.669431:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072354432 00000100:00100000:1.0:1788482847.669460:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788482847.669468:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072354432:12345-0@lo:501: 00000100:00100000:1.0:1788482847.669805:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072354432:12345-0@lo:501: Request processed in 336us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482847.669813:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788482847.669846:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072354432:0@lo:501: 00000100:00100000:1.0:1788482847.669875:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072354560:0@lo:503: 00000100:00100000:1.0:1788482847.669913:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.669927:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.669940:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072354560 00000100:00100000:1.0:1788482847.669944:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072354560 00000100:00100000:1.0:1788482847.669965:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788482847.669972:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072354560:12345-0@lo:503: 00000100:00100000:1.0:1788482847.670318:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072354560:12345-0@lo:503: Request processed in 346us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482847.670326:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788482847.670362:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072354560:0@lo:503: 00000100:00100000:1.0:1788482847.670549:0:7866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7866:1875360072354688:0@lo:502: 00000100:00100000:1.0:1788482847.670583:0:7866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.670602:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072354688 00000100:00100000:1.0:1788482847.670606:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072354688 00000100:00100000:1.0:1788482847.670626:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788482847.670633:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7866:x1875360072354688:12345-0@lo:502: 00000100:00100000:1.0:1788482847.670838:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7866:x1875360072354688:12345-0@lo:502: Request processed in 204us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482847.670854:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788482847.670881:0:7866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.670893:0:7866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7866:1875360072354688:0@lo:502: 00000100:00100000:1.0:1788482847.670930:0:7866:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7866:1875360072354816:0@lo:502: 00000100:00100000:1.0:1788482847.670959:0:7866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.670976:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072354816 00000100:00100000:1.0:1788482847.670979:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072354816 00000100:00100000:1.0:1788482847.670997:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788482847.671003:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7866:x1875360072354816:12345-0@lo:502: 00000100:00100000:1.0:1788482847.671111:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:7866:x1875360072354816:12345-0@lo:502: Request processed in 107us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482847.671119:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788482847.671143:0:7866:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.671154:0:7866:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7866:1875360072354816:0@lo:502: 00000040:00080000:1.0:1788482847.671173:0:7866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788482847.671222:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788482847.671237:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788482847.671269:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.671280:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482847.671290:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788482847.671293:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788482847.671296:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788482847.671316:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.671330:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.671341:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482847.671352:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072354944:0@lo:101: 00000100:00100000:1.0:1788482847.671390:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.671405:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180a4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.671416:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072354944 00000100:00100000:1.0:1788482847.671419:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072354944 00000100:00100000:1.0:1788482847.671441:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788482847.671446:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072354944:12345-0@lo:101: 00010000:00010000:1.0:1788482847.671454:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482847.671481:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78a81 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.671502:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78a81 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.671512:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a81 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.671523:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627400, rc 0) 00000100:00100000:1.0:1788482847.671550:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072354944:12345-0@lo:101: Request processed in 104us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482847.671557:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788482847.671582:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072354944:0@lo:101: 00010000:00010000:1.0:1788482847.671599:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.671608:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482847.671650:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355072:0@lo:501: 00000100:00100000:1.0:1788482847.671680:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.671725:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.671919:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072355072 00000100:00100000:2.0:1788482847.671928:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072355072 00000100:00100000:2.0:1788482847.671961:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788482847.671969:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072355072:12345-0@lo:501: 00000100:00100000:2.0:1788482847.672215:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072355072:12345-0@lo:501: Request processed in 247us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.672222:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788482847.672273:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355072:0@lo:501: 00000100:00100000:2.0:1788482847.672301:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355200:0@lo:503: 00000100:00100000:2.0:1788482847.672339:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.672352:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.672362:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072355200 00000100:00100000:2.0:1788482847.672365:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072355200 00000100:00100000:2.0:1788482847.672396:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788482847.672401:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072355200:12345-0@lo:503: 00000100:00100000:2.0:1788482847.672672:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072355200:12345-0@lo:503: Request processed in 270us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.672678:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788482847.672710:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355200:0@lo:503: 00000100:00100000:2.0:1788482847.672931:0:7867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7867:1875360072355328:0@lo:502: 00000100:00100000:2.0:1788482847.672962:0:7867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.672981:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072355328 00000100:00100000:2.0:1788482847.672984:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072355328 00000100:00100000:2.0:1788482847.673004:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788482847.673009:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:7867:x1875360072355328:12345-0@lo:502: 00000100:00100000:2.0:1788482847.673163:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:7867:x1875360072355328:12345-0@lo:502: Request processed in 152us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.673169:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788482847.673201:0:7867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91830e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.673218:0:7867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7867:1875360072355328:0@lo:502: 00000020:01000000:2.0:1788482847.673239:0:7867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482847.673276:0:7867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482847.673279:0:7867:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788482847.673285:0:7867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788482847.673288:0:7867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788482847.673301:0:7867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7867:1875360072355456:0@lo:502: 00000100:00100000:2.0:1788482847.673331:0:7867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.673347:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072355456 00000100:00100000:2.0:1788482847.673350:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072355456 00000100:00100000:2.0:1788482847.673367:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788482847.673384:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:7867:x1875360072355456:12345-0@lo:502: 00000100:00100000:2.0:1788482847.673473:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:7867:x1875360072355456:12345-0@lo:502: Request processed in 90us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.673479:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788482847.673503:0:7867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91830e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.673515:0:7867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7867:1875360072355456:0@lo:502: 00000020:01000000:2.0:1788482847.673531:0:7867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482847.673535:0:7867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482847.673536:0:7867:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788482847.673540:0:7867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788482847.673585:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788482847.673603:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788482847.673612:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.673622:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482847.673642:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788482847.673644:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb9070c3000 from 30 10000000:01000000:2.0:1788482847.673647:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788482847.673669:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.673677:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.673685:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482847.673697:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355584:0@lo:101: 00000100:00100000:2.0:1788482847.673723:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.673734:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91830e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.673737:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072355584 00000100:00100000:1.0:1788482847.673741:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072355584 00000100:00100000:1.0:1788482847.673767:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788482847.673773:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072355584:12345-0@lo:101: 00010000:00010000:1.0:1788482847.673781:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482847.673793:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78a8f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.673814:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78a8f expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.673823:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a8f expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.673832:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626e00, rc 0) 00000100:00100000:1.0:1788482847.673870:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072355584:12345-0@lo:101: Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482847.673876:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788482847.674981:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355584:0@lo:101: 00010000:00010000:2.0:1788482847.675004:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.675016:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482847.675084:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355712:0@lo:501: 00000100:00100000:2.0:1788482847.675737:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.675797:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91830e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482847.676973:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072355712 00000100:00100000:3.0:1788482847.676984:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072355712 00000100:00100000:3.0:1788482847.677037:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788482847.677048:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072355712:12345-0@lo:501: 00000100:00100000:3.0:1788482847.677384:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072355712:12345-0@lo:501: Request processed in 325us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.677393:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788482847.677527:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355712:0@lo:501: 00000100:00100000:2.0:1788482847.677577:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355840:0@lo:503: 00000100:00100000:2.0:1788482847.677635:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.677670:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91830e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482847.677729:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072355840 00000100:00100000:3.0:1788482847.677734:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072355840 00000100:00100000:3.0:1788482847.678349:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788482847.678360:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072355840:12345-0@lo:503: 00000100:00100000:3.0:1788482847.678550:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072355840:12345-0@lo:503: Request processed in 192us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.678556:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788482847.687313:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072355840:0@lo:503: 00000100:00100000:2.0:1788482847.687566:0:7868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7868:1875360072355968:0@lo:502: 00000100:00100000:2.0:1788482847.687639:0:7868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.687681:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072355968 00000100:00100000:2.0:1788482847.687687:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072355968 00000100:00100000:2.0:1788482847.687731:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788482847.687741:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:7868:x1875360072355968:12345-0@lo:502: 00000100:00100000:2.0:1788482847.688107:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:7868:x1875360072355968:12345-0@lo:502: Request processed in 367us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.688115:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788482847.688177:0:7868:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91830ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.688190:0:7868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7868:1875360072355968:0@lo:502: 00000100:00100000:2.0:1788482847.688229:0:7868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7868:1875360072356096:0@lo:502: 00000100:00100000:2.0:1788482847.688286:0:7868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.688306:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072356096 00000100:00100000:2.0:1788482847.688309:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072356096 00000100:00100000:2.0:1788482847.688328:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788482847.688333:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:7868:x1875360072356096:12345-0@lo:502: 00000100:00100000:2.0:1788482847.688450:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:7868:x1875360072356096:12345-0@lo:502: Request processed in 116us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.688456:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788482847.688484:0:7868:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.688494:0:7868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7868:1875360072356096:0@lo:502: 00000040:00080000:2.0:1788482847.692012:0:7868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788482847.692105:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788482847.692125:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788482847.692143:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.692156:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482847.692170:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788482847.692173:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eb9070c3000 from 5 10000000:01000000:2.0:1788482847.692176:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788482847.692240:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.692266:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.692280:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482847.692312:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356224:0@lo:101: 00000100:00100000:2.0:1788482847.692412:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.692441:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.692468:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072356224 00000100:00100000:2.0:1788482847.692476:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072356224 00000100:00100000:2.0:1788482847.692523:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788482847.692532:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072356224:12345-0@lo:101: 00010000:00010000:2.0:1788482847.692545:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482847.692575:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d3800/0x42820277aad78aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78a9d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.692598:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d3800/0x42820277aad78aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78a9d expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.692609:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d3800/0x42820277aad78aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a9d expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.692618:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d3800, rc 0) 00000100:00100000:2.0:1788482847.692655:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072356224:12345-0@lo:101: Request processed in 123us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.692662:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788482847.692718:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356224:0@lo:101: 00010000:00010000:2.0:1788482847.692732:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.692741:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482847.692788:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356352:0@lo:256: 00000100:00100000:2.0:1788482847.692821:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.692834:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.694662:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072356352 00000100:00100000:2.0:1788482847.694683:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072356352 00000100:00100000:2.0:1788482847.694753:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788482847.694765:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072356352:12345-0@lo:256: 20000000:01000000:2.0:1788482847.694793:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788482847.694819:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788482847.694826:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788482847.696622:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072356352:12345-0@lo:256: Request processed in 1845us (3785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.696643:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788482847.696823:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356352:0@lo:256: 10000000:01000000:3.0:1788482847.697129:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788482847.697142:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482847.697154:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482847.697179:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788482847.697182:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788482847.697185:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788482847.697227:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482847.697236:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482847.697245:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482847.697287:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356480:0@lo:101: 00000100:00100000:3.0:1788482847.697326:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482847.697382:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482847.697401:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072356480 00000100:00100000:3.0:1788482847.697407:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072356480 00000100:00100000:3.0:1788482847.697447:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788482847.697458:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072356480:12345-0@lo:101: 00010000:00010000:3.0:1788482847.697473:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482847.697488:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78aab expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482847.697511:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78aab expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482847.697521:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78aab expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482847.697540:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492200, rc 0) 00000100:00100000:3.0:1788482847.697569:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072356480:12345-0@lo:101: Request processed in 112us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.697575:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788482847.697607:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356480:0@lo:101: 00010000:00010000:3.0:1788482847.697623:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482847.697633:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482847.697687:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356608:0@lo:501: 00000100:00100000:3.0:1788482847.697709:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482847.697724:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482847.697736:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072356608 00000100:00100000:3.0:1788482847.697739:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072356608 00000100:00100000:3.0:1788482847.697759:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788482847.697766:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072356608:12345-0@lo:501: 00000100:00100000:3.0:1788482847.699626:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072356608:12345-0@lo:501: Request processed in 1856us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.699637:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788482847.705510:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356608:0@lo:501: 00000100:00100000:2.0:1788482847.705581:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356736:0@lo:503: 00000100:00100000:2.0:1788482847.705657:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.705704:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb906340a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788482847.705966:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072356736 00000100:00100000:3.0:1788482847.705975:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072356736 00000100:00100000:3.0:1788482847.706040:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788482847.706051:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072356736:12345-0@lo:503: 00000100:00100000:3.0:1788482847.706460:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072356736:12345-0@lo:503: Request processed in 411us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.706474:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788482847.706546:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072356736:0@lo:503: 00000100:00100000:0.0:1788482847.708395:0:7871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7871:1875360072356864:0@lo:502: 00000100:00100000:0.0:1788482847.708469:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482847.708528:0:7871:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93723d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482847.708577:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072356864 00000100:00100000:3.0:1788482847.708584:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072356864 00000100:00100000:3.0:1788482847.708632:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788482847.708642:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:7871:x1875360072356864:12345-0@lo:502: 00000100:00100000:3.0:1788482847.709011:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:7871:x1875360072356864:12345-0@lo:502: Request processed in 369us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.709020:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788482847.709089:0:7871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7871:1875360072356864:0@lo:502: 00000020:01000000:0.0:1788482847.709124:0:7871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788482847.709132:0:7871:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788482847.709140:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482847.709142:0:7871:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788482847.709148:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788482847.709153:0:7871:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:0.0:1788482847.709178:0:7871:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788482847.709182:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788482847.709198:0:7871:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9eb93f394d28) 00000020:00000080:0.0:1788482847.709234:0:7871:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788482847.709242:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788482847.709549:0:7871:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788482847.709555:0:7871:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788482847.709564:0:7871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad78ac0 00010000:00080000:0.0:1788482847.709595:0:7871:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb92163a000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1788482847.709837:0:7871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788482847.710453:0:7871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788482847.710468:0:7871:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788482847.711294:0:7871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482847.711993:0:7871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788482847.712054:0:7871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788482847.712125:0:7871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788482847.713163:0:7872:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788482847.713170:0:7872:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788482847.714471:0:7871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788482847.714488:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788482847.714637:0:7871:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788482847.714668:0:7871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad78ac7 00000100:00080000:0.0:1788482847.714685:0:7871:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788482847.714693:0:7871:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eb92163a000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788482847.714739:0:7871:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb92ec5a680 x1875360072356992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788482847.714768:0:7871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788482847.714828:0:7871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482847.714832:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482847.714834:0:7871:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788482847.714837:0:7871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482847.714842:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482847.714843:0:7871:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788482847.714846:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788482847.714855:0:7871:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788482847.714890:0:7871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7871:1875360072357120:0@lo:502: 00000100:00100000:0.0:1788482847.714974:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482847.715239:0:7871:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90313e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.716482:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072357120 00000100:00100000:2.0:1788482847.716495:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072357120 00000100:00100000:2.0:1788482847.716556:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788482847.716569:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:7871:x1875360072357120:12345-0@lo:502: 00000100:00100000:2.0:1788482847.717359:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:7871:x1875360072357120:12345-0@lo:502: Request processed in 788us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.717380:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788482847.717467:0:7871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:7871:1875360072357120:0@lo:502: 00000020:01000000:2.0:1788482847.717507:0:7871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482847.717516:0:7871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482847.717519:0:7871:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788482847.717524:0:7871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788482847.717617:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788482847.717641:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788482847.717655:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.717668:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482847.717689:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788482847.717692:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eb920884d28 from 1 10000000:01000000:2.0:1788482847.717695:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788482847.717737:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.717745:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.717754:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482847.717775:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072357248:0@lo:101: 00000100:00100000:2.0:1788482847.717815:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482847.717989:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072356992:0@lo:8: 00000100:00100000:3.0:1788482847.718029:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482847.718061:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072356992 00000100:00100000:3.0:1788482847.718067:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072356992 00000100:00100000:3.0:1788482847.718105:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788482847.718114:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3276:x1875360072356992:12345-0@lo:8: 00010000:00080000:3.0:1788482847.718144:0:6660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1788482847.718178:0:6660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad78ad5 00002000:00100000:3.0:1788482847.718194:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9eb9056f1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788482847.718199:0:6660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788482847.718204:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788482847.718354:0:6660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788482847.718577:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788482847.718616:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb9056f2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788482847.718676:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3276:x1875360072356992:12345-0@lo:8: Request processed in 561us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.718684:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482847.718919:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bc300 going to sleep for 11 seconds 00000100:00100000:2.0:1788482847.718938:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072357248 00000100:00100000:2.0:1788482847.718945:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072357248 00000100:00100000:2.0:1788482847.718990:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788482847.718998:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072357248:12345-0@lo:101: 00010000:00010000:2.0:1788482847.719010:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482847.719046:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78ace expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.719073:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78ace expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.719084:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78ace expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.719106:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780600, rc 0) 00000100:00100000:2.0:1788482847.719143:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072357248:12345-0@lo:101: Request processed in 145us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.719150:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788482847.719195:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072357248:0@lo:101: 00010000:00010000:2.0:1788482847.719213:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482847.719225:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482847.719315:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072357376:0@lo:501: 00000100:00100000:2.0:1788482847.719347:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482847.719381:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072357376 00000100:00100000:2.0:1788482847.719384:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072357376 00000100:00100000:2.0:1788482847.719402:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788482847.719408:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072357376:12345-0@lo:501: 00000100:00100000:2.0:1788482847.719654:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072357376:12345-0@lo:501: Request processed in 245us (305us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788482847.719661:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1788482847.721910:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92ec5a680 x1875360072356992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788482857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482847.721932:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788482847.721942:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788482847.721951:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788482847.721958:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788482847.721961:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb92163a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788482847.721979:0:3276:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788482847.721986:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072356992:0@lo:8: 00000004:00080000:3.0:1788482847.722034:0:7872:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788482847.722178:0:7872:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164887927618ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788482847.726482:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.726533:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072357376:0@lo:501: 10000000:01000000:1.0:1788482847.726637:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788482847.726648:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482847.726661:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788482847.798485:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788482847.895072:0:7873:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788482847.895110:0:7873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7873:1875360072357632:0@lo:7: 00000100:00100000:3.0:1788482847.895208:0:7873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482847.895310:0:7873:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482847.895349:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072357504:0@lo:13: 00000100:00100000:3.0:1788482847.895388:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482847.895438:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072357632 00000100:00100000:3.0:1788482847.895448:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072357632 00000100:00100000:3.0:1788482847.895518:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788482847.895530:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7873:x1875360072357632:12345-0@lo:7: 00000100:00080000:2.0:1788482847.896811:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788482847.896847:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072357504 00000100:00100000:2.0:1788482847.896858:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072357504 00000100:00100000:2.0:1788482847.896919:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482847.896931:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072357504:12345-0@lo:13: 00002000:00000024:2.0:1788482847.896963:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788482847.897069:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072357504:12345-0@lo:13: Request processed in 141us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482847.897077:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788482847.899778:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb9406f6d80 x1875360072357504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482847.899806:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072357504:0@lo:13: 00002000:00080000:3.0:1788482847.916140:0:6662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788482847.916149:0:6662:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788482847.916383:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7873:x1875360072357632:12345-0@lo:7: Request processed in 20838us (21158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482847.916400:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788482847.926743:0:7873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb9406f5f80 x1875360072357632/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788482863 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482847.926769:0:7873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7873:1875360072357632:0@lo:7: 00000004:00080000:0.0:1788482847.926794:0:7873:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788482847.926858:0:7873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7873:1875360072357760:0@lo:5: 00000100:00100000:0.0:1788482847.926931:0:7873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482847.927001:0:7873:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90313e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482847.927074:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072357760 00000100:00100000:3.0:1788482847.927083:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072357760 00000100:00100000:3.0:1788482847.927167:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788482847.927177:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7873:x1875360072357760:12345-0@lo:5: 00002000:00080000:3.0:1788482847.927212:0:6663:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788482847.927216:0:6663:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788482847.927732:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7873:x1875360072357760:12345-0@lo:5: Request processed in 555us (798us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788482847.927742:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788482847.927780:0:7873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92ec58a80 x1875360072357760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482863 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482847.927796:0:7873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7873:1875360072357760:0@lo:5: 00000004:00080000:3.0:1788482847.927809:0:7873:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788482847.927839:0:7873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7873:1875360072357888:0@lo:700: 00000100:00100000:3.0:1788482847.927869:0:7873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482847.927894:0:7873:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169600 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.929038:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072357888 00000100:00100000:1.0:1788482847.929053:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072357888 00000100:00100000:1.0:1788482847.929108:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482847.929120:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7873:x1875360072357888:12345-0@lo:700: 00000100:00100000:1.0:1788482847.929171:0:6669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6669:1875360072358016:0@lo:700: 00000100:00100000:1.0:1788482847.929223:0:6669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482847.929302:0:6669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b036840 going to sleep for 11 seconds 00000100:00100000:1.0:1788482847.929321:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072358016 00000100:00100000:1.0:1788482847.929325:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072358016 00000100:00100000:1.0:1788482847.929352:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482847.929359:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6669:x1875360072358016:12345-0@lo:700: 40000000:02000000:0.0:1788482848.005973:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788482848.017181:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6669:x1875360072358016:12345-0@lo:700: Request processed in 87815us (87950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482848.017196:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788482848.017506:0:6669:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937267800 x1875360072358016/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788482863 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482848.017528:0:6669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6669:1875360072358016:0@lo:700: 40000000:02000000:3.0:1788482848.017545:0:6669:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788482848.139517:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788482848.139536:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788482848.140210:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7873:x1875360072357888:12345-0@lo:700: Request processed in 211083us (212330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482848.140233:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788482848.143302:0:7873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb9406f7100 x1875360072357888/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788482863 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482848.143316:0:7873:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788482848.143334:0:7873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7873:1875360072357888:0@lo:700: 00000004:02000040:0.0:1788482848.169945:0:7873:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788482848.174991:0:7873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7873:1875360072358144:0@lo:5: 00000100:00100000:2.0:1788482848.175057:0:7873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482848.175105:0:7873:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086e96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482848.176450:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072358144 00000100:00100000:3.0:1788482848.176460:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072358144 00000100:00100000:3.0:1788482848.176510:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788482848.176517:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7873:x1875360072358144:12345-0@lo:5: 00002000:00080000:3.0:1788482848.180573:0:6662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788482848.180606:0:6662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788482848.183299:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7873:x1875360072358144:12345-0@lo:5: Request processed in 6775us (8234us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788482848.183313:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788482848.183315:0:7873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb920895880 x1875360072358144/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788482864 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482848.183332:0:7873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7873:1875360072358144:0@lo:5: 00000004:00080000:1.0:1788482848.183346:0:7873:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788482848.627814:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788482849.058730:0:7969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788482849.202383:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072358272:0@lo:13: 00000100:00100000:0.0:1788482849.202460:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482849.202719:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072358272 00000100:00100000:1.0:1788482849.202737:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072358272 00000100:00100000:1.0:1788482849.203025:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788482849.203037:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072358272:12345-0@lo:13: 00002000:00000024:1.0:1788482849.203083:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482849.203136:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072358272:12345-0@lo:13: Request processed in 103us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482849.203144:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788482849.203236:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937267800 x1875360072358272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482849.203286:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072358272:0@lo:13: 00000100:00080000:2.0:1788482849.203809:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788482849.652285:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482850.677638:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482851.699769:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482852.724639:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482852.786688:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072358528:0@lo:400: 00000100:00100000:0.0:1788482852.786784:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482852.786871:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072359040:0@lo:400: 00000100:00100000:0.0:1788482852.786904:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482852.786945:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788482852.786951:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072358400:0@lo:400: 00000100:00100000:0.0:1788482852.786984:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482852.787008:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072358912:0@lo:400: 00000100:00100000:0.0:1788482852.787031:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482852.787062:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072358784:0@lo:400: 00000100:00100000:0.0:1788482852.787089:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482852.787110:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788482852.787130:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072358656:0@lo:400: 00000100:00100000:0.0:1788482852.787155:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482852.787189:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072359040 00000100:00100000:0.0:1788482852.787199:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072359040 00000100:00100000:0.0:1788482852.787303:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072358784 00000100:00100000:0.0:1788482852.787308:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072358784 00000100:00100000:0.0:1788482852.787328:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788482852.787339:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875360072359040:12345-0@lo:400: 00000100:00100000:0.0:1788482852.787401:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875360072359040:12345-0@lo:400: Request processed in 64us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482852.787409:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788482852.787430:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482852.787436:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072358784:12345-0@lo:400: 00000100:00100000:0.0:1788482852.787469:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072358784:12345-0@lo:400: Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482852.787476:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482852.787497:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072358400 00000100:00100000:0.0:1788482852.787509:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072358400 00000100:00100000:0.0:1788482852.787537:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788482852.787545:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072358400:12345-0@lo:400: 00000100:00100000:0.0:1788482852.787575:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072358400:12345-0@lo:400: Request processed in 31us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482852.787582:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788482852.787619:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072358528 00000100:00100000:0.0:1788482852.787623:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072358528 00000100:00100000:0.0:1788482852.787648:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072358912 00000100:00100000:0.0:1788482852.787650:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072358912 00000100:00100000:0.0:1788482852.787663:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072358656 00000100:00100000:0.0:1788482852.787665:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072358656 00000100:00100000:0.0:1788482852.787679:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788482852.787685:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072358528:12345-0@lo:400: 00000100:00100000:0.0:1788482852.787718:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072358528:12345-0@lo:400: Request processed in 33us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482852.787724:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788482852.787736:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788482852.787743:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072358912:12345-0@lo:400: 00000100:00100000:0.0:1788482852.787770:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072358912:12345-0@lo:400: Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482852.787776:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788482852.787787:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788482852.787793:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072358656:12345-0@lo:400: 00000100:00100000:0.0:1788482852.787818:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072358656:12345-0@lo:400: Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482852.787824:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788482852.787875:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92ec5a680 x1875360072358656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482852.787894:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072358656:0@lo:400: 00010000:00080000:0.0:1788482852.787906:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92ec59500 x1875360072358784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482852.787915:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072358784:0@lo:400: 00000100:00100000:0.0:1788482852.787948:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072358400:0@lo:400: 00010000:00080000:0.0:1788482852.787958:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f257b80 x1875360072358912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482852.787967:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072358912:0@lo:400: 00010000:00080000:0.0:1788482852.787978:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92ec5b100 x1875360072358528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788482868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482852.787987:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072358528:0@lo:400: 00010000:00080000:0.0:1788482852.787996:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f254700 x1875360072359040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482852.788003:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072359040:0@lo:400: 00000100:00080000:2.0:1788482852.789937:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788482852.789950:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788482852.789953:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788482853.305376:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072359168:0@lo:13: 00000100:00100000:0.0:1788482853.305474:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482853.305600:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072359168 00000100:00100000:0.0:1788482853.305610:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072359168 00000100:00100000:0.0:1788482853.305674:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788482853.305686:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875360072359168:12345-0@lo:13: 00002000:00000024:0.0:1788482853.305736:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482853.305807:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875360072359168:12345-0@lo:13: Request processed in 123us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482853.305816:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788482853.305871:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f254700 x1875360072359168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482853.305898:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072359168:0@lo:13: 00000001:00080000:2.0:1788482853.383618:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788482853.746543:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482854.324871:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482854.324908:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072359296:0@lo:13: 00000100:00100000:2.0:1788482854.325006:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482854.325100:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072359296 00000100:00100000:2.0:1788482854.325110:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072359296 00000100:00100000:2.0:1788482854.325181:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788482854.325192:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072359296:12345-0@lo:13: 00002000:00000024:2.0:1788482854.325236:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482854.325327:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072359296:12345-0@lo:13: Request processed in 135us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482854.325359:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788482854.325385:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788482854.325427:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb920894000 x1875360072359296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482854.325454:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072359296:0@lo:13: 00010000:00010000:1.0:1788482854.771510:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482854.983598:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482854.983707:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063946880 00000100:00100000:1.0:1788482854.983726:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063946880 00000100:00100000:1.0:1788482854.983799:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:1.0:1788482854.983811:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1875360063946880:12345-192.168.201.6@tcp:250: 00010000:00080000:1.0:1788482854.983857:0:5802:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b4e829f8-ccd7-488a-828b-8ba668cc410b@192.168.201.6@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1788482854.983906:0:5802:0:(genops.c:1385:class_connect()) connect: client b4e829f8-ccd7-488a-828b-8ba668cc410b, cookie 0x42820277aad78ae3 00000100:00080000:1.0:1788482854.984126:0:5802:0:(import.c:65:import_set_state_nolock()) ffff9eb9087dd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482854.984442:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+5:2350:x1875360063946880:12345-192.168.201.6@tcp:250: Request processed in 631us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482854.984451:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:0.0:1788482854.994081:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482854.994171:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063947008 00000100:00100000:1.0:1788482854.994194:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063947008 00000100:00100000:1.0:1788482854.994307:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:1.0:1788482854.994321:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+5:5581:x1875360063947008:12345-192.168.201.6@tcp:101: 00010000:00010000:1.0:1788482854.994354:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482854.994384:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70778b0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482854.994453:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482854.996634:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482854.996650:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626000, rc 0) 00000100:00100000:1.0:1788482854.996799:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+6:5581:x1875360063947008:12345-192.168.201.6@tcp:101: Request processed in 2479us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482854.996809:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:3.0:1788482855.011033:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.012618:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063947136 00000100:00100000:3.0:1788482855.012641:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063947136 00000100:00100000:3.0:1788482855.012738:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:3.0:1788482855.012753:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+6:5581:x1875360063947136:12345-192.168.201.6@tcp:501: 00000100:00100000:3.0:1788482855.013789:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+6:5581:x1875360063947136:12345-192.168.201.6@tcp:501: Request processed in 1031us (2764us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788482855.013803:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:2.0:1788482855.020909:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482855.021233:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063947264 00000100:00100000:1.0:1788482855.021281:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063947264 00000100:00100000:1.0:1788482855.021354:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:1.0:1788482855.021370:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+6:5581:x1875360063947264:12345-192.168.201.6@tcp:101: 00010000:00010000:1.0:1788482855.021396:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482855.021420:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70778b7 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482855.021454:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482855.021467:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482855.021479:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627a00, rc 0) 00000100:00100000:1.0:1788482855.022463:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+7:5581:x1875360063947264:12345-192.168.201.6@tcp:101: Request processed in 1087us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482855.022506:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:2.0:1788482855.027020:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.027113:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063947392 00000100:00100000:3.0:1788482855.027128:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063947392 00000100:00100000:3.0:1788482855.027349:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:3.0:1788482855.027363:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+7:5581:x1875360063947392:12345-192.168.201.6@tcp:501: 00000100:00100000:3.0:1788482855.027749:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5581:x1875360063947392:12345-192.168.201.6@tcp:501: Request processed in 389us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482855.027756:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:2.0:1788482855.032830:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.032954:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063947520 00000100:00100000:3.0:1788482855.032968:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063947520 00000100:00100000:3.0:1788482855.033041:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1788482855.033054:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5581:x1875360063947520:12345-192.168.201.6@tcp:503: 00000100:00100000:3.0:1788482855.033814:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5581:x1875360063947520:12345-192.168.201.6@tcp:503: Request processed in 757us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482855.033835:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1788482855.037645:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482855.038112:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063947648 00000100:00100000:0.0:1788482855.038127:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063947648 00000100:00100000:0.0:1788482855.038216:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:0.0:1788482855.038229:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5600:x1875360063947648:12345-192.168.201.6@tcp:502: 00000100:00100000:0.0:1788482855.038740:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5600:x1875360063947648:12345-192.168.201.6@tcp:502: Request processed in 511us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482855.038751:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:2.0:1788482855.077284:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.077508:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063947776 00000100:00100000:3.0:1788482855.077522:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063947776 00000100:00100000:3.0:1788482855.077594:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:3.0:1788482855.077607:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5600:x1875360063947776:12345-192.168.201.6@tcp:502: 00000100:00100000:3.0:1788482855.079192:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5600:x1875360063947776:12345-192.168.201.6@tcp:502: Request processed in 1569us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482855.079212:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:2.0:1788482855.086697:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.086777:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063947904 00000100:00100000:3.0:1788482855.086793:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063947904 00000100:00100000:3.0:1788482855.086859:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:3.0:1788482855.086970:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5581:x1875360063947904:12345-192.168.201.6@tcp:101: 00010000:00010000:3.0:1788482855.086995:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482855.087021:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901493800/0x42820277aad78af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70778e1 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482855.087058:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901493800/0x42820277aad78af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e1 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482855.087071:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901493800/0x42820277aad78af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e1 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482855.087083:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493800, rc 0) 00000100:00100000:3.0:1788482855.087237:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5581:x1875360063947904:12345-192.168.201.6@tcp:101: Request processed in 306us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482855.087275:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:2.0:1788482855.094646:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.095713:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063948032 00000100:00100000:3.0:1788482855.095729:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063948032 00000100:00100000:3.0:1788482855.095792:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:3.0:1788482855.095804:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5581:x1875360063948032:12345-192.168.201.6@tcp:256: 20000000:01000000:3.0:1788482855.095838:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788482855.095861:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788482855.095865:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788482855.095869:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788482855.095871:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788482855.098395:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5581:x1875360063948032:12345-192.168.201.6@tcp:256: Request processed in 2576us (3751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482855.098415:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:0.0:1788482855.107549:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.107621:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063948160 00000100:00100000:3.0:1788482855.107640:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063948160 00000100:00100000:3.0:1788482855.107732:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:3.0:1788482855.108027:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5581:x1875360063948160:12345-192.168.201.6@tcp:101: 00010000:00010000:3.0:1788482855.108125:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482855.108154:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70778e8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482855.108320:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482855.108336:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482855.108348:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493a00, rc 0) 00000100:00100000:3.0:1788482855.108539:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5581:x1875360063948160:12345-192.168.201.6@tcp:101: Request processed in 793us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482855.108570:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:1.0:1788482855.112721:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.113018:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063948288 00000100:00100000:3.0:1788482855.113037:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063948288 00000100:00100000:3.0:1788482855.113233:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:3.0:1788482855.113289:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5581:x1875360063948288:12345-192.168.201.6@tcp:501: 00000100:00100000:2.0:1788482855.113810:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5581:x1875360063948288:12345-192.168.201.6@tcp:501: Request processed in 564us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482855.113820:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:0.0:1788482855.116981:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482855.118083:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063948416 00000100:00100000:1.0:1788482855.118103:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063948416 00000100:00100000:1.0:1788482855.120604:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:1.0:1788482855.120635:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5581:x1875360063948416:12345-192.168.201.6@tcp:503: 00000100:00100000:1.0:1788482855.122321:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5581:x1875360063948416:12345-192.168.201.6@tcp:503: Request processed in 1678us (5341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482855.122339:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:1.0:1788482855.126392:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482855.126465:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063948544 00000100:00100000:1.0:1788482855.126491:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063948544 00000100:00100000:1.0:1788482855.126683:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:1.0:1788482855.126699:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5606:x1875360063948544:12345-192.168.201.6@tcp:502: 00000100:00100000:1.0:1788482855.127095:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5606:x1875360063948544:12345-192.168.201.6@tcp:502: Request processed in 397us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482855.127106:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:1.0:1788482855.135974:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482855.136081:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063948672 00000100:00100000:3.0:1788482855.136101:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063948672 00000100:00100000:3.0:1788482855.136359:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:3.0:1788482855.136373:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5606:x1875360063948672:12345-192.168.201.6@tcp:502: 00000100:00100000:3.0:1788482855.136950:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5606:x1875360063948672:12345-192.168.201.6@tcp:502: Request processed in 575us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482855.136960:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:1.0:1788482855.150148:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482855.150419:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063948800 00000100:00100000:2.0:1788482855.150445:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063948800 00000100:00100000:2.0:1788482855.150701:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788482855.150717:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1875360063948800:12345-192.168.201.6@tcp:38: 00010000:00080000:2.0:1788482855.150762:0:6958:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1788482855.150832:0:6958:0:(genops.c:1385:class_connect()) connect: client aa30c745-265d-4a44-8753-67e411452897, cookie 0x42820277aad78b06 00000004:00100000:2.0:1788482855.150874:0:6958:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1788482855.150884:0:6958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788482855.225978:0:6958:0:(import.c:65:import_set_state_nolock()) ffff9eb9087de000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482855.226112:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2350:x1875360063948800:12345-192.168.201.6@tcp:38: Request processed in 75395us (75983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482855.226125:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1788482855.733504:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482855.733566:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482855.733736:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063949056 00000100:00100000:2.0:1788482855.733750:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063949056 00000100:00100000:2.0:1788482855.733983:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063948928 00000100:00100000:2.0:1788482855.734018:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063948928 00000100:00100000:2.0:1788482855.734052:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788482855.734066:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+7:5581:x1875360063949056:12345-192.168.201.6@tcp:41: 00000004:00000024:2.0:1788482855.734129:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788482855.734942:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+7:5581:x1875360063949056:12345-192.168.201.6@tcp:41: Request processed in 872us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482855.734953:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788482855.734987:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1788482855.734999:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:0:x1875360063948928:12345-192.168.201.6@tcp:41: 00000004:00000024:2.0:1788482855.735017:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788482855.735048:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:0:x1875360063948928:12345-192.168.201.6@tcp:41: Request processed in 52us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482855.735054:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00080000:0.0:1788482855.735649:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482855.738679:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482855.739293:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063949184 00000100:00100000:2.0:1788482855.739309:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063949184 00000100:00100000:2.0:1788482855.739404:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:2.0:1788482855.739419:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:5581:x1875360063949184:12345-192.168.201.6@tcp:40: 00000100:00100000:2.0:1788482855.739568:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:5581:x1875360063949184:12345-192.168.201.6@tcp:40: Request processed in 153us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482855.739578:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788482855.743591:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482855.744135:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482855.744288:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063949312 00000100:00100000:0.0:1788482855.744301:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063949312 00000100:00100000:0.0:1788482855.744351:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063949440 00000100:00100000:0.0:1788482855.744354:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063949440 00000100:00100000:0.0:1788482855.744370:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1788482855.744382:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875360063949312:12345-192.168.201.6@tcp:8: 00010000:00080000:0.0:1788482855.744423:0:6660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1788482855.744476:0:6660:0:(genops.c:1385:class_connect()) connect: client aa30c745-265d-4a44-8753-67e411452897, cookie 0x42820277aad78b0d 00002000:00100000:0.0:1788482855.744492:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa30c745-265d-4a44-8753-67e411452897/ffff9eb92163e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788482855.744522:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788482855.745105:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788482855.745146:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb92163f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482855.745959:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2350:x1875360063949312:12345-192.168.201.6@tcp:8: Request processed in 1572us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482855.745972:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1788482855.746015:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:0.0:1788482855.746023:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875360063949440:12345-192.168.201.6@tcp:8: 00010000:00080000:0.0:1788482855.746051:0:6660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1788482855.746083:0:6660:0:(genops.c:1385:class_connect()) connect: client aa30c745-265d-4a44-8753-67e411452897, cookie 0x42820277aad78b14 00002000:00100000:0.0:1788482855.746096:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa30c745-265d-4a44-8753-67e411452897/ffff9eb921639000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788482855.746119:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788482855.746826:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788482855.747066:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb92163b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482855.747132:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2350:x1875360063949440:12345-192.168.201.6@tcp:8: Request processed in 1107us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482855.747141:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1788482855.755937:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482855.756074:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482855.757440:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063949696 00000100:00100000:0.0:1788482855.757470:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063949696 00000100:00100000:0.0:1788482855.757569:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:0.0:1788482855.757584:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2352:x1875360063949696:12345-192.168.201.6@tcp:400: 00000100:00100000:0.0:1788482855.757676:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2352:x1875360063949696:12345-192.168.201.6@tcp:400: Request processed in 96us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482855.757685:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:3.0:1788482855.758214:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063949568 00000100:00100000:3.0:1788482855.758222:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063949568 00000100:00100000:3.0:1788482855.759668:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1788482855.759693:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+6:5581:x1875360063949568:12345-192.168.201.6@tcp:33: 00010000:00010000:1.0:1788482855.794419:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788482855.832980:0:5810:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 73181us 00000004:00200000:2.0:1788482855.849074:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788482855.849472:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+6:5581:x1875360063949568:12345-192.168.201.6@tcp:33: Request processed in 89782us (93543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482855.849490:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788482856.147810:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482856.147976:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063949824 00000100:00100000:1.0:1788482856.147990:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063949824 00000100:00100000:1.0:1788482856.148090:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788482856.148105:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:5623:x1875360063949824:12345-192.168.201.6@tcp:101: 00010000:00010000:1.0:1788482856.148132:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482856.148166:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78b1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077912 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482856.148327:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad78b22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482856.148345:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad78b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482856.148709:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad78b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482856.148979:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788482856.148985:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482856.149065:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad78b22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482856.149627:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78b1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077912 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482856.149652:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad78b22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077912 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482856.149673:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9050b3900) 00010000:00010000:1.0:1788482856.149676:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788482856.149680:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627200, rc 0) 00000100:00100000:1.0:1788482856.149776:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+7:5623:x1875360063949824:12345-192.168.201.6@tcp:101: Request processed in 1673us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482856.149785:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000001:00100000:0.0:1788482856.487135:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00010000:00010000:1.0:1788482856.821641:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482857.843056:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482857.908238:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072359424:0@lo:400: 00000100:00100000:3.0:1788482857.908378:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482857.908528:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072359424 00000100:00100000:0.0:1788482857.908542:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072359424 00000100:00100000:0.0:1788482857.908633:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788482857.908644:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072359424:12345-0@lo:400: 00000100:00100000:2.0:1788482857.909396:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072359552:0@lo:400: 00000100:00100000:2.0:1788482857.909467:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482857.909512:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072359552 00000100:00100000:2.0:1788482857.909516:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072359552 00000100:00100000:2.0:1788482857.909558:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788482857.909566:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072359552:12345-0@lo:400: 00000100:00100000:2.0:1788482857.909614:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072359552:12345-0@lo:400: Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482857.909621:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788482857.909675:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072359552:0@lo:400: 00000100:00100000:0.0:1788482857.913168:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072359424:12345-0@lo:400: Request processed in 4510us (4774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482857.913191:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788482857.913465:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072359424:0@lo:400: 00000100:00100000:1.0:1788482857.913678:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072360064:0@lo:400: 00000100:00100000:1.0:1788482857.913752:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482857.913782:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482857.913789:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072359936:0@lo:400: 00000100:00100000:1.0:1788482857.913814:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482857.913857:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072359936 00000100:00100000:1.0:1788482857.913866:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072359936 00000100:00100000:2.0:1788482857.913887:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072359680:0@lo:400: 00000100:00100000:2.0:1788482857.913920:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482857.913932:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072359680 00000100:00100000:1.0:1788482857.913935:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072359680 00000100:00100000:2.0:1788482857.913945:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482857.913951:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072359808:0@lo:400: 00000100:00100000:1.0:1788482857.913960:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788482857.913970:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072359936:12345-0@lo:400: 00000100:00100000:2.0:1788482857.913973:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482857.914002:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788482857.914010:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072359680:12345-0@lo:400: 00000100:00100000:1.0:1788482857.914025:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072359936:12345-0@lo:400: Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482857.914031:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788482857.914040:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072359680:12345-0@lo:400: Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482857.914047:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788482857.914068:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072359680:0@lo:400: 00000100:00100000:1.0:1788482857.914068:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072359936:0@lo:400: 00000100:00080000:0.0:1788482857.914430:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482857.914446:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072360064 00000100:00100000:0.0:1788482857.914450:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072360064 00000100:00100000:0.0:1788482857.914496:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072359808 00000100:00100000:0.0:1788482857.914499:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072359808 00000100:00100000:0.0:1788482857.914517:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482857.914524:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072360064:12345-0@lo:400: 00000100:00100000:0.0:1788482857.914565:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072360064:12345-0@lo:400: Request processed in 42us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482857.914571:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482857.914584:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788482857.914590:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072359808:12345-0@lo:400: 00000100:00100000:0.0:1788482857.914622:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072359808:12345-0@lo:400: Request processed in 32us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482857.914628:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788482857.914650:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937267800 x1875360072359808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482857.914661:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072359808:0@lo:400: 00000100:00080000:1.0:1788482857.914730:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482857.914734:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788482857.914751:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728d880 x1875360072360064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482857.914767:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788482857.914778:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072360064:0@lo:400: 00000100:00100000:1.0:1788482858.365090:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482858.365166:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063949952 00000100:00100000:2.0:1788482858.365180:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063949952 00000100:00080000:1.0:1788482858.365285:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482858.365305:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788482858.365317:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+7:5676:x1875360063949952:12345-192.168.201.6@tcp:41: 00000004:00000024:2.0:1788482858.365370:0:6958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788482858.365482:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+7:5676:x1875360063949952:12345-192.168.201.6@tcp:41: Request processed in 167us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482858.365490:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788482858.370202:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482858.370415:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063950080 00000100:00100000:2.0:1788482858.370427:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063950080 00000100:00100000:2.0:1788482858.370522:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1788482858.370535:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa30c745-265d-4a44-8753-67e411452897+5:5676:x1875360063950080:12345-192.168.201.6@tcp:13: 00002000:00000024:2.0:1788482858.370580:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482858.370814:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa30c745-265d-4a44-8753-67e411452897+5:5676:x1875360063950080:12345-192.168.201.6@tcp:13: Request processed in 281us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482858.370822:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00080000:1.0:1788482858.372331:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482858.383445:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482858.383600:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063950208 00000100:00100000:0.0:1788482858.383613:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063950208 00000100:00100000:0.0:1788482858.383705:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:0.0:1788482858.383728:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa30c745-265d-4a44-8753-67e411452897+6:5676:x1875360063950208:12345-192.168.201.6@tcp:13: 00002000:00000024:0.0:1788482858.383767:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482858.383857:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa30c745-265d-4a44-8753-67e411452897+6:5676:x1875360063950208:12345-192.168.201.6@tcp:13: Request processed in 142us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482858.383865:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:1.0:1788482858.384485:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788482858.419694:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072360192:0@lo:13: 00000100:00100000:3.0:1788482858.419800:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482858.421070:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072360192 00000100:00100000:2.0:1788482858.421087:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072360192 00000100:00100000:2.0:1788482858.421172:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788482858.421196:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072360192:12345-0@lo:13: 00002000:00000024:2.0:1788482858.421231:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482858.425121:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072360192:12345-0@lo:13: Request processed in 3921us (5304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482858.425138:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788482858.434530:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728fb80 x1875360072360192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482858.434578:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072360192:0@lo:13: 00010000:00010000:1.0:1788482858.867840:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482859.443511:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072360320:0@lo:13: 00000100:00100000:2.0:1788482859.443624:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482859.455701:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072360320 00000100:00100000:2.0:1788482859.455723:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072360320 00000100:00100000:2.0:1788482859.455865:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788482859.455886:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072360320:12345-0@lo:13: 00002000:00000024:2.0:1788482859.455947:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482859.456086:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072360320:12345-0@lo:13: Request processed in 208us (12463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482859.456112:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788482859.456218:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb920897480 x1875360072360320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482859.456245:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072360320:0@lo:13: 00000100:00080000:0.0:1788482859.456683:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788482859.890460:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788482860.555552:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000001:00100000:2.0:1788482860.556120:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00010000:00010000:1.0:1788482860.914536:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482861.022063:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482861.022132:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482861.022178:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482861.022211:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482861.022246:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063950464 00000100:00100000:3.0:1788482861.022283:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063950464 00000100:00100000:3.0:1788482861.022377:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:3.0:1788482861.022391:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063950464:12345-192.168.201.6@tcp:400: 00000100:00100000:3.0:1788482861.022501:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063950464:12345-192.168.201.6@tcp:400: Request processed in 114us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482861.022508:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:3.0:1788482861.025443:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063950720 00000100:00100000:3.0:1788482861.025456:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063950720 00000100:00100000:3.0:1788482861.025514:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063950592 00000100:00100000:3.0:1788482861.025518:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063950592 00000100:00100000:3.0:1788482861.025542:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788482861.025552:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063950720:12345-192.168.201.6@tcp:400: 00000100:00100000:3.0:1788482861.025626:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063950720:12345-192.168.201.6@tcp:400: Request processed in 74us (3492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482861.025633:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788482861.025658:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788482861.025665:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063950592:12345-192.168.201.6@tcp:400: 00000100:00100000:3.0:1788482861.025690:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063950592:12345-192.168.201.6@tcp:400: Request processed in 26us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482861.025696:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788482861.025715:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063950336 00000100:00100000:3.0:1788482861.025719:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063950336 00000100:00100000:3.0:1788482861.025745:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:3.0:1788482861.025753:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2354:x1875360063950336:12345-192.168.201.6@tcp:400: 00000100:00100000:3.0:1788482861.025777:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2354:x1875360063950336:12345-192.168.201.6@tcp:400: Request processed in 25us (3600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482861.025784:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00080000:3.0:1788482861.025817:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482861.025821:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482861.025824:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788482861.305877:0:8277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788482861.938623:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482862.966524:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482863.028624:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072360704:0@lo:400: 00000100:00100000:3.0:1788482863.028697:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482863.028766:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482863.028772:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072360832:0@lo:400: 00000100:00100000:3.0:1788482863.028799:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482863.028836:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072360704 00000100:00100000:3.0:1788482863.028844:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072360704 00000100:00100000:3.0:1788482863.028900:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788482863.028910:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072360704:12345-0@lo:400: 00000100:00100000:3.0:1788482863.028955:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072360704:12345-0@lo:400: Request processed in 47us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482863.028971:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788482863.028993:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072360832 00000100:00100000:3.0:1788482863.028996:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072360832 00000100:00100000:3.0:1788482863.029020:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788482863.029025:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072360832:12345-0@lo:400: 00000100:00100000:3.0:1788482863.029052:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072360832:12345-0@lo:400: Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482863.029058:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788482863.029072:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482863.029078:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788482863.029125:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e13b80 x1875360072360832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482863.029143:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072360832:0@lo:400: 00000100:00100000:3.0:1788482863.029155:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072360704:0@lo:400: 00000100:00100000:0.0:1788482863.029331:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072360448:0@lo:400: 00000100:00100000:0.0:1788482863.029363:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482863.029396:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072360960:0@lo:400: 00000100:00100000:0.0:1788482863.029417:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482863.029437:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788482863.029442:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072360576:0@lo:400: 00000100:00100000:0.0:1788482863.029462:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482863.029477:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072361088:0@lo:400: 00000100:00100000:0.0:1788482863.029494:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482863.029518:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072360960 00000100:00100000:0.0:1788482863.029522:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072360960 00000100:00100000:0.0:1788482863.029553:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072360576 00000100:00100000:0.0:1788482863.029556:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072360576 00000100:00100000:0.0:1788482863.029569:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482863.029575:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072360960:12345-0@lo:400: 00000100:00100000:0.0:1788482863.029621:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072360960:12345-0@lo:400: Request processed in 46us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482863.029626:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482863.029640:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788482863.029646:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072360576:12345-0@lo:400: 00000100:00100000:0.0:1788482863.029671:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072360576:12345-0@lo:400: Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482863.029676:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788482863.029706:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072361088 00000100:00100000:0.0:1788482863.029709:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072361088 00000100:00100000:0.0:1788482863.029730:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788482863.029735:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072361088:12345-0@lo:400: 00000100:00100000:0.0:1788482863.029765:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072361088:12345-0@lo:400: Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482863.029771:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788482863.029784:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482863.029787:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482863.029814:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072360576:0@lo:400: 00010000:00080000:0.0:1788482863.029825:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e10a80 x1875360072361088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482863.029834:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072361088:0@lo:400: 00000100:00100000:0.0:1788482863.029842:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072360960:0@lo:400: 00000100:00100000:3.0:1788482863.030025:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072360448 00000100:00100000:3.0:1788482863.030029:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072360448 00000100:00100000:3.0:1788482863.030063:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788482863.030069:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072360448:12345-0@lo:400: 00000100:00100000:3.0:1788482863.030120:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072360448:12345-0@lo:400: Request processed in 51us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482863.030126:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788482863.030187:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072360448:0@lo:400: 00000100:00100000:2.0:1788482863.541329:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072361216:0@lo:13: 00000100:00100000:2.0:1788482863.541445:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482863.541669:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072361216 00000100:00100000:1.0:1788482863.541682:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072361216 00000100:00100000:1.0:1788482863.541761:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788482863.541774:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072361216:12345-0@lo:13: 00002000:00000024:1.0:1788482863.541822:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482863.541885:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072361216:12345-0@lo:13: Request processed in 113us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482863.541901:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788482863.542112:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728c700 x1875360072361216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482863.542133:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072361216:0@lo:13: 00010000:00010000:1.0:1788482863.987422:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482864.566872:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482864.566909:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072361344:0@lo:13: 00000100:00100000:0.0:1788482864.567036:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482864.567410:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072361344 00000100:00100000:1.0:1788482864.567422:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072361344 00000100:00100000:1.0:1788482864.567498:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788482864.567510:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072361344:12345-0@lo:13: 00002000:00000024:1.0:1788482864.567558:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482864.567629:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072361344:12345-0@lo:13: Request processed in 121us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482864.567654:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788482864.567707:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f257800 x1875360072361344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482864.567730:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072361344:0@lo:13: 00010000:00010000:3.0:1788482865.010665:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788482865.402190:0:8425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbd196e20 20000000:00000080:0.0:1788482865.402214:0:8425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eb9072c1800 uarg=0000000000000000 20000000:01000000:0.0:1788482865.402603:0:8425:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788482865.402606:0:8425:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788482865.402609:0:8425:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788482865.402615:0:8425:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788482865.402620:0:8425:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788482865.402634:0:8425:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788482865.402636:0:8425:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788482865.402865:0:8425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788482865.402868:0:8425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788482865.403795:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788482865.404658:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788482865.404722:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788482865.404760:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788482865.404776:0:8425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788482865.404778:0:8425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788482865.405719:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788482865.406174:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788482865.406239:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788482865.406664:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788482865.406680:0:8425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788482865.406683:0:8425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788482865.407410:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788482865.407745:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788482865.407799:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788482865.407836:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788482865.407848:0:8425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788482865.407850:0:8425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788482865.408632:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788482865.408977:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788482865.409024:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788482865.409085:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1788482865.409105:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788482865.409124:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409142:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a1f expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409150:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a49 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409158:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a73 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409164:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a81 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409182:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a8f expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409189:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78aab expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409196:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78ace expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409205:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409213:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409221:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409552:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409568:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 9 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.409583:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f257100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361472:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482865.409728:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409736:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 9 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.409753:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f255500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361600:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482865.409787:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78ace expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409796:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78ace expref: 18 pid: 5801 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.409805:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f256680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361728:0@lo:104: 00000100:00100000:0.0:1788482865.409847:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482865.409886:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78aab expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409894:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78aab expref: 18 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.409902:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f255880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361856:0@lo:104: 00000100:00100000:0.0:1788482865.409926:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482865.409962:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78a8f expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.409970:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78a8f expref: 18 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.409979:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f256300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361984:0@lo:104: 00010000:00010000:0.0:1788482865.410004:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78a81 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.410011:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78a81 expref: 18 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.410028:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f254380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072362112:0@lo:104: 00010000:00010000:0.0:1788482865.410054:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78a73 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.410072:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78a73 expref: 18 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.410080:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f257800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072362240:0@lo:104: 00010000:00010000:0.0:1788482865.410106:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78a49 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.410113:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78a49 expref: 18 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.410121:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072362368:0@lo:104: 00010000:00010000:0.0:1788482865.410146:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78a1f expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482865.410154:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78a1f expref: 18 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482865.410162:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072362496:0@lo:104: 00000100:00100000:0.0:1788482865.410179:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217ca9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482865.410278:0:5792:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788482865.410358:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482865.410370:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482865.410379:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482865.410386:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482865.410406:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482865.410415:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072361728 00000100:00100000:2.0:1788482865.410421:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072361728 00000100:00100000:2.0:1788482865.410453:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072361856 00000100:00100000:2.0:1788482865.410455:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072361856 00000100:00100000:2.0:1788482865.410462:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072361984 00000100:00100000:2.0:1788482865.410464:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072361984 00000100:00100000:2.0:1788482865.410471:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072362112 00000100:00100000:2.0:1788482865.410473:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072362112 00000100:00100000:2.0:1788482865.410480:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072362240 00000100:00100000:2.0:1788482865.410482:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072362240 00000100:00100000:2.0:1788482865.410495:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072362368 00000100:00100000:2.0:1788482865.410497:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072362368 00000100:00100000:2.0:1788482865.410505:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072362496 00000100:00100000:2.0:1788482865.410508:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072362496 00000100:00100000:2.0:1788482865.410520:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788482865.410529:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:8425:x1875360072361728:12345-0@lo:104: 00010000:00010000:2.0:1788482865.410540:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.410598:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482865.410604:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+9:8425:x1875360072361728:12345-0@lo:104: Request processed in 77us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482865.410612:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788482865.410629:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788482865.410635:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f5ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+8:8425:x1875360072361856:12345-0@lo:104: 00010000:00010000:2.0:1788482865.410643:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.410677:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788482865.410682:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f5ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+8:8425:x1875360072361856:12345-0@lo:104: Request processed in 48us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482865.410687:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788482865.410724:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788482865.410730:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+7:8425:x1875360072361984:12345-0@lo:104: 00010000:00010000:2.0:1788482865.410737:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.410762:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788482865.410773:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+7:8425:x1875360072361984:12345-0@lo:104: Request processed in 44us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482865.410779:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788482865.410790:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788482865.410795:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+6:8425:x1875360072362112:12345-0@lo:104: 00010000:00010000:2.0:1788482865.410802:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.410828:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788482865.410833:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+6:8425:x1875360072362112:12345-0@lo:104: Request processed in 38us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482865.410838:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788482865.410849:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788482865.410855:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:8425:x1875360072362240:12345-0@lo:104: 00010000:00010000:2.0:1788482865.410861:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.410883:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788482865.410887:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:8425:x1875360072362240:12345-0@lo:104: Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482865.410893:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788482865.410904:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788482865.410909:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:8425:x1875360072362368:12345-0@lo:104: 00010000:00010000:2.0:1788482865.410915:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.410939:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788482865.410949:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:8425:x1875360072362368:12345-0@lo:104: Request processed in 41us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482865.410954:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788482865.410967:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788482865.410972:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:8425:x1875360072362496:12345-0@lo:104: 00010000:00010000:2.0:1788482865.410980:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.411007:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788482865.411012:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:8425:x1875360072362496:12345-0@lo:104: Request processed in 40us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482865.411017:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788482865.411115:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f256680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361728:0@lo:104: 00000100:00100000:0.0:1788482865.411125:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f255880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361856:0@lo:104: 00000100:00100000:0.0:1788482865.411130:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f256300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361984:0@lo:104: 00000100:00100000:0.0:1788482865.411136:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f254380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072362112:0@lo:104: 00000100:00100000:0.0:1788482865.411151:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f257800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072362240:0@lo:104: 00000100:00100000:0.0:1788482865.411158:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072362368:0@lo:104: 00000100:00100000:0.0:1788482865.411164:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072362496:0@lo:104: 00010000:00010000:1.0:1788482865.411238:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788482865.411245:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411285:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb9421d3000 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482865.411384:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411393:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482865.411400:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482865.411406:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482865.411438:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411444:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482865.411467:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411474:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3000/0x42820277aad78ace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78adc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411497:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788482865.411500:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411506:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482865.411508:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411515:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482865.411522:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482865.411526:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482865.411540:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411546:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482865.411551:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411558:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb901492a00/0x42820277aad78aab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411567:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788482865.411570:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411597:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb9421d2a00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482865.411599:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411605:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482865.411611:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482865.411616:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482865.411630:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411636:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482865.411650:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411657:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2a00/0x42820277aad78a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411666:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788482865.411669:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411675:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204a400 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482865.411678:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411695:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482865.411702:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482865.411708:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482865.411723:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411729:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482865.411735:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411741:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204a400/0x42820277aad78a81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a88 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411753:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788482865.411756:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411761:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204be00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482865.411764:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411771:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482865.411778:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482865.411789:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482865.411802:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411807:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482865.411811:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411817:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204be00/0x42820277aad78a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a7a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411826:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788482865.411829:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411835:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb9421d3400 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482865.411838:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411844:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482865.411851:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482865.411855:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482865.411866:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411872:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482865.411880:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411887:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad78a49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a50 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411896:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482865.411898:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411904:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204aa00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482865.411907:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411913:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482865.411919:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482865.411924:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788482865.411934:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411939:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482865.411942:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411947:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204aa00/0x42820277aad78a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a26 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.411957:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482865.411962:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482865.411964:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482865.411979:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072362752:0@lo:103: 00000100:00100000:1.0:1788482865.412019:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482865.412056:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072363264:0@lo:103: 00000100:00100000:1.0:1788482865.412087:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482865.412106:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788482865.412111:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072362624:0@lo:103: 00000100:00100000:1.0:1788482865.412130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482865.412146:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072363136:0@lo:103: 00000100:00100000:1.0:1788482865.412163:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482865.412182:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072362880:0@lo:103: 00000100:00100000:1.0:1788482865.412203:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482865.412212:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072363392:0@lo:103: 00000100:00100000:1.0:1788482865.412226:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482865.412235:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482865.412239:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072363008:0@lo:103: 00000100:00100000:1.0:1788482865.412282:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482865.412667:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072362752 00000100:00100000:1.0:1788482865.412675:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072362752 00010000:00010000:1.0:1788482865.412711:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78aab expref: 19 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.412734:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072363264 00000100:00100000:1.0:1788482865.412737:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072363264 00010000:00010000:1.0:1788482865.412747:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a49 expref: 20 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.412768:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072362624 00000100:00100000:1.0:1788482865.412770:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072362624 00010000:00010000:1.0:1788482865.412780:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78ace expref: 21 pid: 5801 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.412789:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072363136 00000100:00100000:1.0:1788482865.412791:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072363136 00010000:00010000:1.0:1788482865.412799:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a73 expref: 22 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.412808:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072362880 00000100:00100000:1.0:1788482865.412810:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072362880 00010000:00010000:1.0:1788482865.412819:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a8f expref: 23 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.412827:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072363392 00000100:00100000:1.0:1788482865.412830:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072363392 00010000:00010000:1.0:1788482865.412838:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a1f expref: 24 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.412847:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072363008 00000100:00100000:1.0:1788482865.412849:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072363008 00010000:00010000:1.0:1788482865.412858:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a81 expref: 25 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.412871:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788482865.412879:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+25:3280:x1875360072362752:12345-0@lo:103: 00010000:00010000:1.0:1788482865.412892:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.412897:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78aab expref: 25 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.412917:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78aab expref: 25 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.412931:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492200/0x42820277aad78ab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78aab expref: 25 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.412946:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.413040:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+24:3280:x1875360072362752:12345-0@lo:103: Request processed in 161us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.413047:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788482865.413076:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788482865.413082:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+23:3280:x1875360072363264:12345-0@lo:103: 00010000:00010000:1.0:1788482865.413090:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.413095:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a49 expref: 23 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413104:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78a49 expref: 23 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413114:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900030600/0x42820277aad78a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78a49 expref: 23 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413124:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.413145:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+22:3280:x1875360072363264:12345-0@lo:103: Request processed in 64us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.413151:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788482865.413164:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788482865.413169:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+21:3280:x1875360072362624:12345-0@lo:103: 00010000:00010000:1.0:1788482865.413183:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.413188:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78ace expref: 21 pid: 5801 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413196:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78ace expref: 21 pid: 5801 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413206:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f780600/0x42820277aad78adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78ace expref: 21 pid: 5801 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413214:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.413235:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+20:3280:x1875360072362624:12345-0@lo:103: Request processed in 66us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.413240:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788482865.413285:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788482865.413365:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072363136:12345-0@lo:103: 00010000:00010000:1.0:1788482865.413373:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.413377:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a73 expref: 19 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413385:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78a73 expref: 19 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413393:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d3600/0x42820277aad78a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78a73 expref: 19 pid: 5800 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413402:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.413421:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:3280:x1875360072363136:12345-0@lo:103: Request processed in 59us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.413434:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788482865.413445:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788482865.413450:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3277:x1875360072362880:12345-0@lo:103: 00010000:00010000:1.0:1788482865.413457:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.413461:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a8f expref: 17 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413468:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78a8f expref: 17 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413478:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f626e00/0x42820277aad78a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78a8f expref: 17 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413485:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.413512:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3277:x1875360072362880:12345-0@lo:103: Request processed in 62us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.413519:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788482865.413530:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788482865.413536:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:3277:x1875360072363392:12345-0@lo:103: 00010000:00010000:1.0:1788482865.413543:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.413547:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a1f expref: 15 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413555:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78a1f expref: 15 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413565:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb94204a200/0x42820277aad78a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78a1f expref: 15 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413585:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.413607:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:3277:x1875360072363392:12345-0@lo:103: Request processed in 71us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.413612:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788482865.413625:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788482865.413631:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:3277:x1875360072363008:12345-0@lo:103: 00010000:00010000:1.0:1788482865.413639:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.413643:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a81 expref: 13 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413651:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78a81 expref: 13 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413660:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f627400/0x42820277aad78a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78a81 expref: 13 pid: 5802 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.413668:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.413689:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:3277:x1875360072363008:12345-0@lo:103: Request processed in 58us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.413694:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788482865.413752:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072363008:0@lo:103: 00000100:00100000:1.0:1788482865.413761:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072362880:0@lo:103: 00000100:00100000:1.0:1788482865.413768:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072363392:0@lo:103: 00010000:00010000:3.0:1788482865.414391:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482865.414686:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072362752:0@lo:103: 00000100:00100000:0.0:1788482865.414699:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072363264:0@lo:103: 00000100:00100000:0.0:1788482865.414716:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072362624:0@lo:103: 00000100:00100000:0.0:1788482865.414725:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072363136:0@lo:103: 00000100:00100000:0.0:1788482865.419829:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482865.419906:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482865.419987:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f257100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361472:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482865.420002:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f255500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8425:1875360072361600:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788482865.420054:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.420401:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063950848 00000100:00100000:1.0:1788482865.420410:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063950848 00010000:00010000:1.0:1788482865.420451:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 10 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.420490:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063950976 00000100:00100000:1.0:1788482865.420494:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063950976 00010000:00010000:1.0:1788482865.420508:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 11 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482865.420521:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788482865.420530:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:2351:x1875360063950848:12345-192.168.201.6@tcp:103: 00010000:00010000:1.0:1788482865.420545:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.420551:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 11 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420563:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 11 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420580:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f627a00/0x42820277aad78af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b7 expref: 11 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420593:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.420648:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2351:x1875360063950848:12345-192.168.201.6@tcp:103: Request processed in 117us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.420655:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788482865.420673:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788482865.420680:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:2352:x1875360063950976:12345-192.168.201.6@tcp:103: 00010000:00010000:1.0:1788482865.420688:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482865.420692:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 9 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420713:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 9 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420723:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f626000/0x42820277aad78aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778b0 expref: 9 pid: 5801 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420734:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420742:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420758:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420765:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420773:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420780:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420787:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900030a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788482865.420792:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420800:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420827:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482865.420836:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482865.420859:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:2352:x1875360063950976:12345-192.168.201.6@tcp:103: Request processed in 180us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482865.420865:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00010000:00010000:2.0:1788482865.421186:0:8425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.421195:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482865.421202:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900030a00/0x42820277aad78b29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.034440:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482866.144808:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482866.144879:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482866.145343:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063951360 00000100:00100000:1.0:1788482866.145362:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063951360 00000100:00100000:1.0:1788482866.145503:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788482866.145522:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063951360:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788482866.145667:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063951360:12345-192.168.201.6@tcp:400: Request processed in 150us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.145677:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00080000:3.0:1788482866.145915:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788482866.146200:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063951104 00000100:00100000:0.0:1788482866.146218:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063951104 00000100:00100000:0.0:1788482866.146349:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:0.0:1788482866.146360:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063951104:12345-192.168.201.6@tcp:400: 00000100:00100000:0.0:1788482866.146444:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063951104:12345-192.168.201.6@tcp:400: Request processed in 87us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.146451:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00080000:1.0:1788482866.147514:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482866.167376:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482866.167456:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482866.167580:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063951488 00000100:00100000:2.0:1788482866.167595:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063951488 00000100:00100000:2.0:1788482866.167683:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:2.0:1788482866.167722:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:5595:x1875360063951488:12345-192.168.201.6@tcp:101: 00010000:00010000:2.0:1788482866.167755:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482866.167788:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f781e00/0x42820277aad78b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077919 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.167833:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f781e00/0x42820277aad78b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077919 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.167851:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f781e00/0x42820277aad78b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077919 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.167866:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781e00, rc 0) 00000100:00100000:2.0:1788482866.167975:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5595:x1875360063951488:12345-192.168.201.6@tcp:101: Request processed in 256us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.167983:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:3.0:1788482866.170678:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063951232 00000100:00100000:3.0:1788482866.170704:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063951232 00000100:00100000:3.0:1788482866.170845:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1788482866.170860:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063951232:12345-192.168.201.6@tcp:400: 00000100:00100000:3.0:1788482866.171323:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063951232:12345-192.168.201.6@tcp:400: Request processed in 463us (3963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482866.171333:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00080000:1.0:1788482866.172033:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482866.172682:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482866.173460:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063951616 00000100:00100000:3.0:1788482866.173476:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063951616 00000100:00100000:2.0:1788482866.173677:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 132 00000100:00100000:2.0:1788482866.173693:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5595:x1875360063951616:12345-192.168.201.6@tcp:501: 00000100:00100000:2.0:1788482866.174173:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5595:x1875360063951616:12345-192.168.201.6@tcp:501: Request processed in 482us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.174184:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 132 00000100:00100000:0.0:1788482866.184306:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482866.184431:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063951744 00000100:00100000:3.0:1788482866.184451:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063951744 00000100:00100000:3.0:1788482866.184538:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:3.0:1788482866.184553:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5595:x1875360063951744:12345-192.168.201.6@tcp:503: 00000100:00100000:3.0:1788482866.184959:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5595:x1875360063951744:12345-192.168.201.6@tcp:503: Request processed in 406us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482866.184969:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:1.0:1788482866.192744:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482866.193495:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063951872 00000100:00100000:3.0:1788482866.193512:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063951872 00000100:00100000:3.0:1788482866.193601:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:3.0:1788482866.193615:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:6064:x1875360063951872:12345-192.168.201.6@tcp:502: 00000100:00100000:3.0:1788482866.194039:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:6064:x1875360063951872:12345-192.168.201.6@tcp:502: Request processed in 425us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482866.194086:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:0.0:1788482866.196623:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482866.197177:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063952000 00000100:00100000:2.0:1788482866.197195:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063952000 00000100:00100000:2.0:1788482866.197322:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:2.0:1788482866.197336:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:6064:x1875360063952000:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788482866.197777:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:6064:x1875360063952000:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 442us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.198467:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:2.0:1788482866.204763:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482866.205163:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063952128 00000100:00100000:0.0:1788482866.205180:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063952128 00000100:00100000:0.0:1788482866.205303:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:0.0:1788482866.205318:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5595:x1875360063952128:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482866.205367:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482866.205392:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb900031e00/0x42820277aad78b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077920 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.205433:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900031e00/0x42820277aad78b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077920 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.205447:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb900031e00/0x42820277aad78b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077920 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.205458:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb900031e00, rc 0) 00000100:00100000:0.0:1788482866.205537:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5595:x1875360063952128:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 223us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.205545:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:1.0:1788482866.216624:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482866.216926:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063952256 00000100:00100000:2.0:1788482866.216943:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063952256 00000100:00100000:2.0:1788482866.217151:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:2.0:1788482866.217466:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5595:x1875360063952256:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482866.217955:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5595:x1875360063952256:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 496us (1348us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788482866.224430:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 137 10000000:01000000:0.0:1788482866.611615:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788482866.611628:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb93f7bc000 from 39 10000000:01000000:0.0:1788482866.611635:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788482866.611704:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.611719:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.611734:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482866.611771:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072363520:0@lo:101: 00000100:00100000:0.0:1788482866.611898:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.612001:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.612161:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072363520 00000100:00100000:1.0:1788482866.612173:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072363520 00000100:00100000:1.0:1788482866.612300:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788482866.612314:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+12:5804:x1875360072363520:12345-0@lo:101: 00010000:00010000:1.0:1788482866.612349:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482866.612371:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f626a00/0x42820277aad78b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78b3e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.612424:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f626a00/0x42820277aad78b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78b3e expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.612438:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f626a00/0x42820277aad78b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78b3e expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.612450:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626a00, rc 0) 00000100:00100000:1.0:1788482866.612515:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072363520:12345-0@lo:101: Request processed in 204us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.612523:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788482866.612742:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072363520:0@lo:101: 00010000:00010000:0.0:1788482866.612761:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.612772:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482866.612849:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072363648:0@lo:501: 00000100:00100000:0.0:1788482866.612882:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.612922:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.612939:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072363648 00000100:00100000:0.0:1788482866.612943:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072363648 00000100:00100000:0.0:1788482866.612969:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788482866.612988:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072363648:12345-0@lo:501: 00000100:00100000:0.0:1788482866.613544:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072363648:12345-0@lo:501: Request processed in 565us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.613554:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788482866.613623:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072363648:0@lo:501: 00000100:00100000:0.0:1788482866.613663:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072363776:0@lo:503: 00000100:00100000:0.0:1788482866.613712:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.613738:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217ca180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.613750:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072363776 00000100:00100000:0.0:1788482866.613755:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072363776 00000100:00100000:0.0:1788482866.613775:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788482866.613783:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072363776:12345-0@lo:503: 00000100:00100000:0.0:1788482866.613951:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072363776:12345-0@lo:503: Request processed in 168us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.613971:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788482866.614212:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072363776:0@lo:503: 00000100:00100000:0.0:1788482866.618130:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8444:1875360072363904:0@lo:502: 00000100:00100000:0.0:1788482866.618316:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.619081:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.619451:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072363904 00000100:00100000:1.0:1788482866.619468:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072363904 00000100:00100000:1.0:1788482866.619565:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788482866.619579:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:8444:x1875360072363904:12345-0@lo:502: 00000100:00100000:1.0:1788482866.623133:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:8444:x1875360072363904:12345-0@lo:502: Request processed in 2197us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.623163:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788482866.624621:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8444:1875360072363904:0@lo:502: 00000100:00100000:3.0:1788482866.624783:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8444:1875360072364032:0@lo:502: 00000100:00100000:3.0:1788482866.624937:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482866.625477:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.628320:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072364032 00000100:00100000:0.0:1788482866.628349:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072364032 00000100:00100000:0.0:1788482866.628462:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788482866.628478:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:8444:x1875360072364032:12345-0@lo:502: 00000100:00100000:0.0:1788482866.628936:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:8444:x1875360072364032:12345-0@lo:502: Request processed in 461us (3998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.628945:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788482866.633316:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8444:1875360072364032:0@lo:502: 00000040:00080000:3.0:1788482866.633386:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788482866.634185:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788482866.634215:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788482866.634231:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.634261:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482866.634281:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788482866.634284:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788482866.634288:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788482866.634349:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.634358:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.634369:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482866.634432:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364160:0@lo:101: 00000100:00100000:2.0:1788482866.634551:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.634611:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb911580c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.634946:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072364160 00000100:00100000:0.0:1788482866.634958:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072364160 00000100:00100000:0.0:1788482866.635054:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788482866.635068:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+13:5804:x1875360072364160:12345-0@lo:101: 00010000:00010000:0.0:1788482866.635085:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482866.635102:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb900030600/0x42820277aad78b53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78b4c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.635133:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900030600/0x42820277aad78b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78b4c expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.635145:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb900030600/0x42820277aad78b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78b4c expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.635166:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb900030600, rc 0) 00000100:00100000:0.0:1788482866.635229:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072364160:12345-0@lo:101: Request processed in 164us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.635562:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788482866.636972:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364160:0@lo:101: 00010000:00010000:2.0:1788482866.637026:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.637052:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482866.637188:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364288:0@lo:501: 00000100:00100000:2.0:1788482866.637538:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.637652:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb911580c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788482866.652961:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072364288 00000100:00100000:3.0:1788482866.652997:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072364288 00000100:00100000:3.0:1788482866.654357:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788482866.654389:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072364288:12345-0@lo:501: 00000100:00100000:3.0:1788482866.654931:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072364288:12345-0@lo:501: Request processed in 556us (17391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482866.654941:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788482866.655128:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364288:0@lo:501: 00000100:00100000:2.0:1788482866.655229:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364416:0@lo:503: 00000100:00100000:2.0:1788482866.655308:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.671709:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb911580c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.680928:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072364416 00000100:00100000:1.0:1788482866.680959:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072364416 00000100:00100000:1.0:1788482866.681094:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788482866.681110:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072364416:12345-0@lo:503: 00000100:00100000:1.0:1788482866.681888:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072364416:12345-0@lo:503: Request processed in 774us (26571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.681902:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788482866.686092:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364416:0@lo:503: 00000100:00100000:2.0:1788482866.686912:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8445:1875360072364544:0@lo:502: 00000100:00100000:2.0:1788482866.687075:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.687143:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb911580000 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.688357:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072364544 00000100:00100000:1.0:1788482866.688394:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072364544 00000100:00100000:1.0:1788482866.688479:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788482866.688493:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:8445:x1875360072364544:12345-0@lo:502: 00000100:00100000:1.0:1788482866.688881:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:8445:x1875360072364544:12345-0@lo:502: Request processed in 389us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.688893:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788482866.689774:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8445:1875360072364544:0@lo:502: 00000020:01000000:2.0:1788482866.689838:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482866.689855:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482866.689872:0:8445:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788482866.689880:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788482866.689937:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8445:1875360072364672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482866.690204:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.690371:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb911580000 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.712066:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072364672 00000100:00100000:0.0:1788482866.712097:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072364672 00000100:00100000:1.0:1788482866.720064:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788482866.720101:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:8445:x1875360072364672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482866.720603:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:8445:x1875360072364672:12345-0@lo:502:llog_process_th.0 Request processed in 520us (30397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.720614:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788482866.721164:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8445:1875360072364672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482866.721220:0:8445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482866.721234:0:8445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482866.721237:0:8445:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788482866.721246:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788482866.721587:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788482866.721615:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788482866.721634:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.721649:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482866.721665:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788482866.721669:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb906309000 from 39 10000000:01000000:0.0:1788482866.721673:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788482866.721735:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.721744:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.721752:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482866.721781:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.721849:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.721918:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788482866.724226:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072364800 00000100:00100000:3.0:1788482866.724279:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072364800 00000100:00100000:3.0:1788482866.724376:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788482866.724390:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:5804:x1875360072364800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482866.724414:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482866.724439:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492400/0x42820277aad78b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78b5a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482866.724482:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492400/0x42820277aad78b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78b5a expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482866.724516:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492400/0x42820277aad78b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78b5a expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482866.724527:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492400, rc 0) 00000100:00100000:3.0:1788482866.724650:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072364800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482866.724657:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788482866.725056:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482866.725090:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.725116:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482866.725461:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.725520:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.725592:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.726185:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072364928 00000100:00100000:1.0:1788482866.726198:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072364928 00000100:00100000:1.0:1788482866.726304:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788482866.726315:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072364928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.726773:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072364928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 459us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.726782:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788482866.729055:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072364928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.729151:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072365056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.729317:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.729373:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.729857:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072365056 00000100:00100000:1.0:1788482866.729868:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072365056 00000100:00100000:1.0:1788482866.729940:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788482866.729953:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072365056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.730493:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072365056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 541us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.730503:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788482866.733633:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072365056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.737624:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8446:1875360072365184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482866.737741:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.737814:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.737883:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072365184 00000100:00100000:1.0:1788482866.737900:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072365184 00000100:00100000:1.0:1788482866.737961:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788482866.737971:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:8446:x1875360072365184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482866.738468:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:8446:x1875360072365184:12345-0@lo:502:llog_process_th.0 Request processed in 497us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.738477:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788482866.738587:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8446:1875360072365184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482866.738641:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8446:1875360072365312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482866.738674:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.738704:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.738752:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072365312 00000100:00100000:1.0:1788482866.738757:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072365312 00000100:00100000:1.0:1788482866.738821:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788482866.738830:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:8446:x1875360072365312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482866.738969:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:8446:x1875360072365312:12345-0@lo:502:llog_process_th.0 Request processed in 140us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.738976:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788482866.739034:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8446:1875360072365312:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788482866.739063:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788482866.742122:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788482866.742196:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788482866.742245:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.742283:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482866.742297:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788482866.742300:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788482866.742303:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788482866.742363:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.742372:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.742388:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482866.742428:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072365440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.742533:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.745223:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788482866.747270:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072365440 00000100:00100000:2.0:1788482866.747294:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072365440 00000100:00100000:2.0:1788482866.747387:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788482866.747399:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:5804:x1875360072365440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482866.747422:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482866.747448:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f780a00/0x42820277aad78b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78b68 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.747487:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f780a00/0x42820277aad78b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78b68 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.747500:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f780a00/0x42820277aad78b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78b68 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.747512:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780a00, rc 0) 00000100:00100000:2.0:1788482866.747621:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072365440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.747629:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788482866.747823:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072365440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482866.747848:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.747860:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482866.747964:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072365568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.748051:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.748096:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788482866.748669:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072365568 00000100:00100000:2.0:1788482866.748679:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072365568 00000100:00100000:2.0:1788482866.748726:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788482866.748737:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072365568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482866.749432:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072365568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 692us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.749456:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788482866.749708:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072365568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.749772:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072365696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.749836:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482866.749880:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788482866.755365:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072365696 00000100:00100000:2.0:1788482866.755395:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072365696 00000100:00100000:2.0:1788482866.755512:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788482866.755527:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072365696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482866.755943:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072365696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 417us (6105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.755953:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788482866.758160:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072365696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.762482:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8447:1875360072365824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482866.762612:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.762677:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482866.762776:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072365824 00000100:00100000:2.0:1788482866.762796:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072365824 00000100:00100000:2.0:1788482866.762860:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788482866.762871:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:8447:x1875360072365824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482866.763197:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:8447:x1875360072365824:12345-0@lo:502:llog_process_th.0 Request processed in 325us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.763206:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788482866.763480:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8447:1875360072365824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482866.763520:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788482866.763532:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482866.763535:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788482866.763542:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788482866.763574:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8447:1875360072365952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482866.763617:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482866.763654:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034240 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.763880:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072365952 00000100:00100000:1.0:1788482866.763887:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072365952 00000100:00100000:1.0:1788482866.763921:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788482866.763933:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:8447:x1875360072365952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482866.764170:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:8447:x1875360072365952:12345-0@lo:502:llog_process_th.0 Request processed in 238us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.764179:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788482866.764332:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8447:1875360072365952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788482866.764356:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788482866.764361:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788482866.764364:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788482866.764369:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788482866.764730:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788482866.764755:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788482866.764780:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.764804:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482866.764815:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788482866.764819:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb9070c3000 from 39 10000000:01000000:1.0:1788482866.764824:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788482866.764868:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.764877:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.764899:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482866.764920:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.764964:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.765015:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788482866.765175:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072366080 00000100:00100000:2.0:1788482866.765183:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072366080 00000100:00100000:2.0:1788482866.765237:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788482866.765289:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072366080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482866.765302:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482866.765320:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f780200/0x42820277aad78b7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78b76 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.765347:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f780200/0x42820277aad78b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78b76 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.765360:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f780200/0x42820277aad78b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78b76 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.765382:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780200, rc 0) 00000100:00100000:2.0:1788482866.765423:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072366080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.765431:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788482866.766056:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482866.766079:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.766091:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482866.766176:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.766230:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.766371:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072366208 00000100:00100000:2.0:1788482866.766377:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072366208 00000100:00100000:2.0:1788482866.766420:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788482866.766430:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072366208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482866.772068:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072366208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5613us (5811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.772091:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788482866.772462:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.772502:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.772581:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.772657:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.772687:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.772752:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072366336 00000100:00100000:0.0:1788482866.772763:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072366336 00000100:00100000:0.0:1788482866.772840:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788482866.772854:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072366336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.773166:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072366336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 305us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.773175:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788482866.774349:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.775091:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8448:1875360072366464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482866.775183:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.775239:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482866.775580:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072366464 00000100:00100000:2.0:1788482866.775592:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072366464 00000100:00100000:2.0:1788482866.775656:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788482866.775671:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:8448:x1875360072366464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482866.776062:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:8448:x1875360072366464:12345-0@lo:502:llog_process_th.0 Request processed in 393us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.776072:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788482866.776366:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8448:1875360072366464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482866.776434:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8448:1875360072366592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482866.776481:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.776529:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482866.776593:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072366592 00000100:00100000:2.0:1788482866.776598:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072366592 00000100:00100000:2.0:1788482866.776635:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788482866.776646:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:8448:x1875360072366592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482866.776835:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:8448:x1875360072366592:12345-0@lo:502:llog_process_th.0 Request processed in 191us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482866.776843:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788482866.776937:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8448:1875360072366592:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788482866.776958:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788482866.777506:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788482866.777533:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788482866.777547:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.777561:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482866.777574:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788482866.777578:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788482866.777582:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788482866.777622:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.777632:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482866.777644:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482866.777663:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788482866.777711:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.777761:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91830f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.777812:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072366720 00000100:00100000:0.0:1788482866.777818:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072366720 00000100:00100000:0.0:1788482866.777865:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788482866.777876:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072366720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482866.777887:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482866.777904:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb900031800/0x42820277aad78b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78b84 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.777933:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900031800/0x42820277aad78b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78b84 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.777962:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb900031800/0x42820277aad78b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78b84 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.777972:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb900031800, rc 0) 00000100:00100000:0.0:1788482866.778025:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072366720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.778032:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788482866.778185:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482866.778199:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.778209:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482866.778299:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.778328:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.778349:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.778462:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072366848 00000100:00100000:0.0:1788482866.778467:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072366848 00000100:00100000:0.0:1788482866.778503:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788482866.778510:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072366848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.778836:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072366848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.778845:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788482866.778966:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.779013:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.779068:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.779101:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788482866.779116:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072366976 00000100:00100000:1.0:1788482866.779120:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072366976 00000100:00100000:1.0:1788482866.779145:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788482866.779152:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072366976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.779601:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072366976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 448us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482866.779608:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788482866.779697:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072366976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482866.794458:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8449:1875360072367104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482866.794615:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.794695:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91830f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.795057:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072367104 00000100:00100000:0.0:1788482866.795070:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072367104 00000100:00100000:0.0:1788482866.795157:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788482866.795176:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:8449:x1875360072367104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482866.795886:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:8449:x1875360072367104:12345-0@lo:502:llog_process_th.0 Request processed in 708us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.795899:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788482866.798204:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8449:1875360072367104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482866.798320:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482866.798340:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482866.798360:0:8449:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788482866.798370:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788482866.798441:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8449:1875360072367232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482866.799100:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482866.799176:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90854a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788482866.799301:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072367232 00000100:00100000:3.0:1788482866.799321:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072367232 00000100:00100000:3.0:1788482866.799384:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788482866.799397:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:8449:x1875360072367232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482866.799757:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:8449:x1875360072367232:12345-0@lo:502:llog_process_th.0 Request processed in 361us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482866.799778:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788482866.800072:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8449:1875360072367232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482866.800105:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482866.800113:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482866.800116:0:8449:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788482866.800121:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788482866.800277:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788482866.800310:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788482866.800327:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.800340:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482866.800352:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788482866.800356:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eb920884d28 from 1 10000000:01000000:1.0:1788482866.800359:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788482866.800400:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.800408:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.800431:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482866.800459:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072367360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.800513:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.800563:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.800623:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072367360 00000100:00100000:0.0:1788482866.800631:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072367360 00000100:00100000:0.0:1788482866.800677:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788482866.800694:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072367360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482866.800707:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482866.800722:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb900031400/0x42820277aad78b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78b92 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.800748:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb900031400/0x42820277aad78b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78b92 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.800758:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb900031400/0x42820277aad78b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78b92 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482866.800767:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb900031400, rc 0) 00000100:00100000:0.0:1788482866.800823:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072367360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482866.800829:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788482866.801009:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072367360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482866.801024:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b99 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.801034:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b99 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482866.801098:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072367488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482866.801125:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482866.801150:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788482866.801196:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072367488 00000100:00100000:0.0:1788482866.801201:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072367488 00000100:00100000:0.0:1788482866.801234:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788482866.801241:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072367488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482866.801609:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072367488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (482us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788482866.801618:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788482866.802062:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072367488:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788482866.802104:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788482866.802113:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b99 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482866.802125:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b99 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482867.060669:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788482867.918044:0:8486:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea3c6cc80 20000000:00000080:2.0:1788482867.918353:0:8486:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eb9072c0400 uarg=0000000000000000 20000000:01000000:2.0:1788482867.918405:0:8486:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788482867.918413:0:8486:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788482867.918417:0:8486:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788482867.924607:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788482867.931222:0:8486:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788482867.942390:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788482867.942446:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788482867.942507:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788482867.942527:0:8486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788482867.942547:0:8486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.942572:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901492800/0x42820277aad78915 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad7890e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.942578:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78970 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.942582:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78a3b expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.942588:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.942593:0:8486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.942630:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.942649:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 9 pid: 5802 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.942663:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875360072367616:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482867.942921:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78a3b expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.942934:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78a3b expref: 18 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.942944:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875360072367744:0@lo:104: 00000100:00100000:0.0:1788482867.942995:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788482867.943049:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78970 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.943057:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78970 expref: 18 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.943066:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875360072367872:0@lo:104: 00000100:00100000:0.0:1788482867.943099:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482867.943284:0:5792:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788482867.943302:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072367744 00000100:00100000:1.0:1788482867.943309:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072367744 00000100:00100000:1.0:1788482867.943347:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072367872 00000100:00100000:1.0:1788482867.943348:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072367872 00000100:00100000:1.0:1788482867.943369:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788482867.943379:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:8486:x1875360072367744:12345-0@lo:104: 00000100:00100000:3.0:1788482867.943384:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:1.0:1788482867.943396:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482867.943403:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788482867.943659:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788482867.943674:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:8486:x1875360072367872:12345-0@lo:104: 00010000:00010000:3.0:1788482867.943694:0:8488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.947476:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788482867.947494:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:8486:x1875360072367744:12345-0@lo:104: Request processed in 4112us (4493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482867.947508:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1788482867.947562:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482867.947570:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.947581:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b400 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482867.947586:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.947596:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482867.947604:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482867.947610:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788482867.947664:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.947692:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482867.947716:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.947724:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204b400/0x42820277aad78a3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78a42 expref: -99 pid: 7604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.947740:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482867.947742:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482867.947743:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482867.947770:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072368000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788482867.947826:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482867.947899:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072368000 00000100:00100000:1.0:1788482867.947907:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072368000 00010000:00010000:1.0:1788482867.947939:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a3b expref: 19 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482867.947974:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788482867.947985:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3278:x1875360072368000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788482867.948001:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482867.948006:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78a3b expref: 19 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.948016:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78a3b expref: 19 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.948046:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482867.948079:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3278:x1875360072368000:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482867.948093:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788482867.948131:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072368000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788482867.951459:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:0.0:1788482867.952552:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901492800/0x42820277aad78915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad7890e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.952578:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb901492800/0x42820277aad78915 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad7890e expref: 18 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.952594:0:8486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875360072368128:0@lo:104: 00010000:00010000:3.0:1788482867.952627:0:8488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788482867.952645:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fee8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:8486:x1875360072367872:12345-0@lo:104: Request processed in 8970us (9539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482867.952665:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788482867.952666:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482867.954688:0:8488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072368128 00000100:00100000:3.0:1788482867.954709:0:8488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072368128 00000100:00100000:3.0:1788482867.955006:0:8488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482867.955033:0:8488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:8486:x1875360072368128:12345-0@lo:104: 00010000:00010000:3.0:1788482867.955061:0:8488:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.955397:0:8486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773540 going to sleep for 11 seconds 00010000:00010000:0.0:1788482867.955458:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492e00/0x42820277aad78a42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78a3b expref: 18 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.955477:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875360072367744:0@lo:104: 00000100:00100000:0.0:1788482867.955486:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875360072367872:0@lo:104: 00000100:00100000:0.0:1788482867.955492:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875360072368128:0@lo:104: 00010000:00010000:1.0:1788482867.955631:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788482867.955645:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.955657:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b000 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482867.955663:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.955675:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482867.955684:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482867.955690:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788482867.955892:0:8488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788482867.955905:0:8488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:8486:x1875360072368128:12345-0@lo:104: Request processed in 886us (3244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482867.955917:0:8488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788482867.956108:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.956222:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788482867.956593:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482867.956657:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482867.956660:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482867.956686:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.956696:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204ae00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:1.0:1788482867.956700:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.956707:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788482867.956738:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482867.956744:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788482867.956817:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482867.956846:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.956870:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204b000/0x42820277aad78970 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78977 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.956887:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482867.956890:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.956891:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482867.956896:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482867.956904:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788482867.956919:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.956920:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072368256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788482867.956940:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204ae00/0x42820277aad7890e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78915 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482867.956964:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482867.956967:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482867.956970:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482867.957005:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482867.957078:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063952384 00000100:00100000:1.0:1788482867.957088:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063952384 00000100:00100000:0.0:1788482867.957101:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482867.957113:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072368384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788482867.957128:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 10 pid: 5802 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.957155:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482867.957166:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072368256 00000100:00100000:1.0:1788482867.957172:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072368256 00010000:00010000:1.0:1788482867.957191:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78970 expref: 18 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482867.957206:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072368384 00000100:00100000:1.0:1788482867.957209:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072368384 00010000:00010000:1.0:1788482867.957226:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901492800/0x42820277aad78915 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad7890e expref: 19 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.957482:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1788482867.957495:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2352:x1875360063952384:12345-192.168.201.6@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788482867.957504:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1788482867.957508:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788482867.957518:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788482867.957519:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 10 pid: 5802 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.957535:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 10 pid: 5802 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.957551:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482867.957588:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2352:x1875360063952384:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 99us (6152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482867.957594:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1788482867.957616:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788482867.957620:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072368256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482867.957646:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482867.957653:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78970 expref: 19 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.957666:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78970 expref: 19 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.957679:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d2200/0x42820277aad78977 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78970 expref: 19 pid: 5801 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.957693:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482867.957851:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072368256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482867.958197:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:3279:x1875360072368256:12345-0@lo:103:ldlm_bl.0 Request processed in 575us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482867.958203:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788482867.958217:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482867.958223:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3279:x1875360072368384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482867.958867:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482867.958874:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901492800/0x42820277aad78915 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad7890e expref: 17 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958884:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901492800/0x42820277aad78915 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad7890e expref: 17 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958897:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492800/0x42820277aad78915 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad7890e expref: 17 pid: 5802 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958911:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958919:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958946:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958954:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958960:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958967:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958974:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788482867.958978:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958986:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.958994:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.959005:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482867.959067:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3279:x1875360072368384:12345-0@lo:103:ldlm_bl.0 Request processed in 843us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482867.959127:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072368384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482867.959453:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788482867.959912:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901493a00/0x42820277aad78aff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e8 expref: 9 pid: 5802 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482867.959925:0:8486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1875360072367616:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482867.959973:0:8486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.959983:0:8486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.959989:0:8486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482867.959996:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb907369600/0x42820277aad78ba0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482868.086987:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482868.146577:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072368640:0@lo:400:kworker.0 00000100:00100000:1.0:1788482868.146694:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482868.146811:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788482868.146818:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072368512:0@lo:400:kworker.0 00000100:00100000:1.0:1788482868.146846:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482868.146870:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072369024:0@lo:400:kworker.0 00000100:00100000:1.0:1788482868.146901:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482868.146947:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072368768:0@lo:400:kworker.0 00000100:00100000:1.0:1788482868.146976:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482868.148243:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482868.148290:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072368896:0@lo:400:kworker.0 00000100:00100000:1.0:1788482868.148352:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482868.148422:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072368640 00000100:00100000:1.0:1788482868.148436:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072368640 00000100:00100000:1.0:1788482868.148534:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072368512 00000100:00100000:1.0:1788482868.148539:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072368512 00000100:00100000:1.0:1788482868.148557:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072368896 00000100:00100000:1.0:1788482868.148560:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072368896 00000100:00100000:1.0:1788482868.148812:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788482868.148826:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072368640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482868.148898:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072368640:12345-0@lo:400:kworker.0 Request processed in 75us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482868.149171:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072369024 00000100:00100000:2.0:1788482868.149177:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072369024 00000100:00100000:2.0:1788482868.149215:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072368768 00000100:00100000:2.0:1788482868.149219:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072368768 00000100:00100000:2.0:1788482868.149235:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788482868.149243:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072369024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482868.149296:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072369024:12345-0@lo:400:kworker.0 Request processed in 54us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482868.149303:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788482868.149324:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788482868.149336:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072368768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482868.149436:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072368768:12345-0@lo:400:kworker.0 Request processed in 106us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482868.149504:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788482868.149569:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728c700 x1875360072368768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482868.149587:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072368768:0@lo:400:kworker.0 00000100:00080000:2.0:1788482868.150328:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788482868.150336:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788482868.150339:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482868.151388:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788482868.153310:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788482868.153383:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072368512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482868.153510:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072368512:12345-0@lo:400:kworker.0 Request processed in 2106us (6662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482868.153521:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788482868.153554:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788482868.153565:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072368896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482868.153612:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072368896:12345-0@lo:400:kworker.0 Request processed in 50us (5260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482868.153619:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788482868.154123:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072368896:0@lo:400:kworker.0 00000100:00100000:1.0:1788482868.154223:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072368512:0@lo:400:kworker.0 00010000:00080000:1.0:1788482868.154655:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728f100 x1875360072369024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482868.154670:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072369024:0@lo:400:kworker.0 00000100:00100000:2.0:1788482868.154831:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072368640:0@lo:400:kworker.0 00000100:00100000:2.0:1788482868.662747:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072369152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482868.662831:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482868.663018:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072369152 00000100:00100000:3.0:1788482868.663027:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072369152 00000100:00100000:3.0:1788482868.663098:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788482868.663109:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072369152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788482868.663151:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482868.669985:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072369152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6859us (7134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482868.670042:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788482868.674900:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728d180 x1875360072369152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482868.674939:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072369152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788482869.107477:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788482869.107526:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788482869.107531:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb93f7bc000 from 4 10000000:01000000:1.0:1788482869.107536:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788482869.107594:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482869.107607:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482869.107621:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482869.107648:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072369280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.107724:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.107787:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788482869.107847:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072369280 00000100:00100000:2.0:1788482869.107858:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072369280 00000100:00100000:2.0:1788482869.107920:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788482869.107931:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072369280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482869.107954:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482869.107970:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78ba7 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.108008:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78ba7 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.108035:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78ba7 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.108047:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780800, rc 0) 00000100:00100000:2.0:1788482869.108097:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072369280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.108105:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788482869.108285:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072369280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482869.108301:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482869.108310:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482869.108382:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072369408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482869.108409:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482869.108432:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788482869.108557:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072369408 00000100:00100000:1.0:1788482869.108562:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072369408 00000100:00100000:1.0:1788482869.108597:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788482869.108604:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072369408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.108916:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072369408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.108925:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788482869.108971:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072369408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.109020:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072369536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.109067:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.109082:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788482869.109094:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072369536 00000100:00100000:1.0:1788482869.109097:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072369536 00000100:00100000:1.0:1788482869.109116:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788482869.109122:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072369536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.109299:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072369536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.109305:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788482869.109341:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072369536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.109589:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8517:1875360072369664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482869.109621:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.109640:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072369664 00000100:00100000:1.0:1788482869.109644:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072369664 00000100:00100000:1.0:1788482869.109661:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788482869.109667:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:8517:x1875360072369664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482869.109786:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:8517:x1875360072369664:12345-0@lo:502:llog_process_th.0 Request processed in 118us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.109794:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788482869.109820:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482869.109832:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8517:1875360072369664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788482869.109853:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482869.109863:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482869.109866:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788482869.109872:0:8517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb93f7bc000 00000020:00000080:1.0:1788482869.109875:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788482869.131423:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8517:1875360072369792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482869.131526:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.131577:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072369792 00000100:00100000:1.0:1788482869.131586:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072369792 00000100:00100000:1.0:1788482869.131645:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788482869.131655:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:8517:x1875360072369792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482869.131894:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:8517:x1875360072369792:12345-0@lo:502:llog_process_th.0 Request processed in 239us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.131902:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788482869.132747:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788482869.132780:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8517:1875360072369792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788482869.132812:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482869.132822:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482869.132824:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788482869.132829:0:8517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788482869.134603:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788482869.134656:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788482869.134678:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482869.134695:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482869.134710:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788482869.134714:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb906309000 from 4 10000000:01000000:1.0:1788482869.134718:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788482869.134784:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482869.134793:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482869.134807:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482869.134842:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072369920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.137124:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.137204:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788482869.137434:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072369920 00000100:00100000:2.0:1788482869.137448:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072369920 00000100:00100000:2.0:1788482869.137529:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788482869.137543:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072369920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482869.137562:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482869.137582:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78bb5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.137611:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78bb5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.137623:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78bb5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.137633:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781600, rc 0) 00000100:00100000:2.0:1788482869.137695:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072369920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.137702:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788482869.146173:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072369920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482869.146203:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482869.146216:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482869.146320:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.146381:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.146421:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482869.146439:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072370048 00000100:00100000:1.0:1788482869.146445:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072370048 00000100:00100000:1.0:1788482869.146483:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788482869.146492:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072370048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.146762:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072370048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.146769:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788482869.146813:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.146843:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.146879:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.146892:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482869.146904:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072370176 00000100:00100000:1.0:1788482869.146908:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072370176 00000100:00100000:1.0:1788482869.146930:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788482869.146963:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072370176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.147123:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072370176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.147129:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788482869.147165:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788482869.159634:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8521:1875360072370304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788482869.159745:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482869.159810:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788482869.159868:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072370304 00000100:00100000:1.0:1788482869.159881:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072370304 00000100:00100000:1.0:1788482869.160155:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788482869.160170:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:8521:x1875360072370304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482869.160453:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:8521:x1875360072370304:12345-0@lo:502:llog_process_th.0 Request processed in 286us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.160462:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788482869.161142:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8521:1875360072370304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788482869.161182:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482869.161192:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482869.161195:0:8521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788482869.161202:0:8521:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb906309000 00000020:00000080:0.0:1788482869.161204:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788482869.161336:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8521:1875360072370432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482869.161401:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482869.161441:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773000 going to sleep for 11 seconds 00000100:00100000:1.0:1788482869.161619:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072370432 00000100:00100000:1.0:1788482869.161628:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072370432 00000100:00100000:1.0:1788482869.161676:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788482869.161686:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:8521:x1875360072370432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482869.161861:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:8521:x1875360072370432:12345-0@lo:502:llog_process_th.0 Request processed in 177us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.161869:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788482869.175431:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8521:1875360072370432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482869.175487:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482869.175513:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482869.175516:0:8521:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788482869.175521:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788482869.175754:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788482869.175780:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788482869.175793:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482869.175806:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788482869.175820:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788482869.175835:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb9070c3000 from 4 10000000:01000000:3.0:1788482869.175839:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788482869.175888:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482869.175897:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482869.175908:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482869.175946:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788482869.176058:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482869.176143:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1788482869.182908:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072370560 00000100:00100000:2.0:1788482869.182928:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072370560 00000100:00100000:2.0:1788482869.183024:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788482869.183037:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072370560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482869.183060:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482869.183087:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78bc3 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.183120:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78bc3 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.183134:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78bc3 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.183144:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780c00, rc 0) 00000100:00100000:2.0:1788482869.183243:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072370560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (7185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.183273:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788482869.183351:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482869.183371:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482869.183381:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482869.183459:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482869.183504:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482869.183541:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788482869.183555:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072370688 00000100:00100000:2.0:1788482869.183559:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072370688 00000100:00100000:2.0:1788482869.183582:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788482869.183589:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072370688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482869.183843:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072370688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.183850:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788482869.183877:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482869.183902:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482869.183940:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482869.183953:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788482869.183964:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072370816 00000100:00100000:2.0:1788482869.183967:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072370816 00000100:00100000:2.0:1788482869.183988:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788482869.183994:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072370816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482869.184178:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072370816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.184185:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788482869.184221:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072370816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.191278:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8525:1875360072370944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482869.191406:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.191473:0:8525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b036840 going to sleep for 11 seconds 00000100:00100000:2.0:1788482869.191540:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072370944 00000100:00100000:2.0:1788482869.191549:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072370944 00000100:00100000:2.0:1788482869.191606:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788482869.191618:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:8525:x1875360072370944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482869.191928:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:8525:x1875360072370944:12345-0@lo:502:llog_process_th.0 Request processed in 312us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.191948:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788482869.192121:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8525:1875360072370944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788482869.192158:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788482869.192176:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788482869.192179:0:8525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788482869.192187:0:8525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb9070c3000 00000020:00000080:1.0:1788482869.192190:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788482869.192313:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8525:1875360072371072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482869.192349:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482869.192371:0:8525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b036840 going to sleep for 11 seconds 00000100:00100000:2.0:1788482869.206488:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072371072 00000100:00100000:2.0:1788482869.206510:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072371072 00000100:00100000:2.0:1788482869.206589:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788482869.206605:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:8525:x1875360072371072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482869.210142:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:8525:x1875360072371072:12345-0@lo:502:llog_process_th.0 Request processed in 3519us (17769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.210165:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788482869.211550:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:8525:1875360072371072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482869.211609:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482869.211622:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482869.211625:0:8525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788482869.211630:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788482869.211867:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788482869.211908:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788482869.211922:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482869.213060:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482869.682643:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482869.682679:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072371200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482869.682778:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482869.682871:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072371200 00000100:00100000:0.0:1788482869.682880:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072371200 00000100:00100000:0.0:1788482869.682950:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788482869.682960:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072371200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482869.683012:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482869.683066:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072371200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482869.683074:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788482869.683127:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93ff51180 x1875360072371200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482869.683150:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072371200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788482869.790612:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482869.790655:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063952512 00000100:00100000:3.0:1788482869.790667:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063952512 00000100:00100000:3.0:1788482869.790731:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 185 00000100:00100000:3.0:1788482869.790746:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:5595:x1875360063952512:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482869.790770:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482869.790795:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077927 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482869.790830:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482869.790843:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482869.790855:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493600, rc 0) 00000100:00100000:3.0:1788482869.794316:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5595:x1875360063952512:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 3563us (3712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482869.794347:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 185 00000100:00100000:2.0:1788482869.800418:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482869.800453:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063952640 00000100:00100000:2.0:1788482869.800463:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063952640 00000100:00100000:2.0:1788482869.800512:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 186 00000100:00100000:2.0:1788482869.800522:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5595:x1875360063952640:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482869.800898:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5595:x1875360063952640:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 376us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.801824:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 186 00000100:00100000:3.0:1788482869.818626:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482869.823504:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063952768 00000100:00100000:1.0:1788482869.823522:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063952768 00000100:00100000:1.0:1788482869.823594:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 187 00000100:00100000:1.0:1788482869.823604:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5595:x1875360063952768:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482869.825204:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:5595:x1875360063952768:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 1586us (6576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.825313:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 187 00000100:00100000:3.0:1788482869.833169:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482869.833319:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063952896 00000100:00100000:1.0:1788482869.833337:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063952896 00000100:00100000:1.0:1788482869.833416:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 188 00000100:00100000:1.0:1788482869.833429:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:6127:x1875360063952896:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788482869.833798:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:6127:x1875360063952896:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 371us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482869.833808:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 188 00000100:00100000:2.0:1788482869.842671:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482869.842854:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063953024 00000100:00100000:3.0:1788482869.842874:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063953024 00000100:00100000:3.0:1788482869.842972:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 189 00000100:00100000:3.0:1788482869.842995:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:6127:x1875360063953024:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788482869.854506:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:6127:x1875360063953024:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 11511us (11836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482869.854551:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 189 00010000:00010000:1.0:1788482870.130450:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482871.157742:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482871.258380:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482871.258430:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482871.258478:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482871.258585:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063953408 00000100:00100000:0.0:1788482871.258597:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063953408 00000100:00100000:0.0:1788482871.258685:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1788482871.258698:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063953408:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482871.258706:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063953152 00000100:00100000:2.0:1788482871.258713:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063953152 00000100:00100000:2.0:1788482871.258752:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:2.0:1788482871.258762:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2351:x1875360063953152:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482871.258803:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2351:x1875360063953152:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 41us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482871.258803:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063953408:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 104us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482871.258817:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:0.0:1788482871.258823:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788482871.259060:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063953280 00000100:00100000:1.0:1788482871.259065:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063953280 00000100:00100000:1.0:1788482871.259117:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788482871.259126:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063953280:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482871.259179:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063953280:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 54us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482871.259208:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00080000:3.0:1788482871.259743:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482871.259751:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788482871.262039:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482871.262341:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063953536 00000100:00100000:2.0:1788482871.262352:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063953536 00000100:00100000:2.0:1788482871.262434:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1788482871.262445:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063953536:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482871.262538:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063953536:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 95us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482871.262545:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00080000:3.0:1788482871.262666:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788482872.178575:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482873.203421:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482873.269400:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072371328:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.269502:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482873.269571:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072371840:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.269602:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482873.269647:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482873.269654:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072371712:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.269682:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482873.269713:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072371456:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.269739:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482873.269755:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072371968:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.269775:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482873.269793:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482873.269798:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072371584:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.269817:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482873.269851:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072371712 00000100:00100000:0.0:1788482873.269861:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072371712 00000100:00100000:0.0:1788482873.269945:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072371968 00000100:00100000:0.0:1788482873.269949:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072371968 00000100:00100000:0.0:1788482873.269971:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788482873.269981:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072371712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270046:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072371712:12345-0@lo:400:kworker.0 Request processed in 66us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482873.270053:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788482873.270071:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788482873.270077:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072371968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270189:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072371968:12345-0@lo:400:kworker.0 Request processed in 112us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482873.270196:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788482873.270243:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93ff50380 x1875360072371968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482873.270288:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072371968:0@lo:400:kworker.0 00010000:00080000:0.0:1788482873.270331:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93ff51880 x1875360072371712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482873.270340:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072371712:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270385:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072371840 00000100:00100000:0.0:1788482873.270389:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072371840 00000100:00100000:0.0:1788482873.270420:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072371456 00000100:00100000:0.0:1788482873.270423:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072371456 00000100:00100000:0.0:1788482873.270435:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072371584 00000100:00100000:0.0:1788482873.270437:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072371584 00000100:00100000:0.0:1788482873.270450:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788482873.270456:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072371840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270495:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072371840:12345-0@lo:400:kworker.0 Request processed in 39us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482873.270502:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788482873.270516:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788482873.270522:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072371456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270552:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072371456:12345-0@lo:400:kworker.0 Request processed in 30us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482873.270557:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788482873.270567:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788482873.270573:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072371584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270597:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072371584:12345-0@lo:400:kworker.0 Request processed in 24us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482873.270602:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788482873.270631:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072371584:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270652:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072371456:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270673:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072371840:0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270728:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072371328 00000100:00100000:0.0:1788482873.270732:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072371328 00000100:00100000:0.0:1788482873.270761:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788482873.270767:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072371328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482873.270801:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072371328:12345-0@lo:400:kworker.0 Request processed in 35us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482873.270808:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788482873.270848:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072371328:0@lo:400:kworker.0 00000100:00080000:0.0:1788482873.270888:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788482873.270893:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482873.270895:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788482873.787429:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482873.787472:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072372096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482873.787601:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482873.787788:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072372096 00000100:00100000:1.0:1788482873.787804:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072372096 00000100:00100000:1.0:1788482873.787895:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788482873.787912:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072372096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482873.787983:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482873.788061:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072372096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482873.788071:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788482873.788212:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728e680 x1875360072372096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482873.788351:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072372096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788482874.226459:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482874.802878:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072372224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482874.803004:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482874.803582:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072372224 00000100:00100000:0.0:1788482874.803596:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072372224 00000100:00100000:0.0:1788482874.803684:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788482874.803700:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072372224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482874.803814:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482874.803952:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072372224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482874.803960:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788482874.804021:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93ff51180 x1875360072372224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482874.804073:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072372224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482875.256497:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482876.274837:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482876.385063:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482876.385120:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482876.385159:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482876.385192:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482876.385233:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063953792 00000100:00100000:3.0:1788482876.385276:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063953792 00000100:00100000:3.0:1788482876.385565:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:3.0:1788482876.385583:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063953792:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482876.385723:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063953792:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 145us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482876.385733:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:3.0:1788482876.385769:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063954048 00000100:00100000:3.0:1788482876.385774:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063954048 00000100:00100000:3.0:1788482876.385807:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063953920 00000100:00100000:3.0:1788482876.385811:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063953920 00000100:00100000:3.0:1788482876.385830:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788482876.385836:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063954048:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482876.385866:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063954048:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482876.385883:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788482876.385896:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1788482876.385903:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063953920:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482876.385929:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063953920:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482876.385936:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00080000:3.0:1788482876.385964:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482876.385969:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482876.385973:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482876.389585:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063953664 00000100:00100000:2.0:1788482876.389616:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063953664 00000100:00100000:2.0:1788482876.391553:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 192 00000100:00100000:2.0:1788482876.391587:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2352:x1875360063953664:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482876.392657:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2352:x1875360063953664:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 1073us (7483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482876.392672:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 192 00000001:02000400:1.0:1788482876.440382:0:8790:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788482877.299387:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482878.323218:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482878.388846:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072372352:0@lo:400:kworker.0 00000100:00100000:0.0:1788482878.388978:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482878.389051:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072372864:0@lo:400:kworker.0 00000100:00100000:0.0:1788482878.389094:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482878.389138:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482878.389144:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072372736:0@lo:400:kworker.0 00000100:00100000:0.0:1788482878.389171:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482878.389215:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072372352 00000100:00100000:0.0:1788482878.389225:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072372352 00000100:00100000:0.0:1788482878.389324:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788482878.389336:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072372352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482878.389397:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072372352:12345-0@lo:400:kworker.0 Request processed in 62us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482878.389405:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788482878.389445:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072372864 00000100:00100000:0.0:1788482878.389450:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072372864 00000100:00100000:0.0:1788482878.389493:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482878.389500:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072372864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482878.389535:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072372864:12345-0@lo:400:kworker.0 Request processed in 36us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482878.389542:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482878.389604:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072372352:0@lo:400:kworker.0 00000100:00100000:0.0:1788482878.389618:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072372864:0@lo:400:kworker.0 00000100:00100000:3.0:1788482878.394367:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072372480:0@lo:400:kworker.0 00000100:00100000:3.0:1788482878.394507:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482878.394564:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072372992:0@lo:400:kworker.0 00000100:00100000:3.0:1788482878.394592:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482878.394656:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072372736 00000100:00100000:3.0:1788482878.394690:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072372736 00000100:00100000:3.0:1788482878.394765:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072372992 00000100:00100000:3.0:1788482878.394767:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072372992 00000100:00100000:3.0:1788482878.394795:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482878.394807:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072372736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482878.394884:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072372736:12345-0@lo:400:kworker.0 Request processed in 79us (5711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482878.394891:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788482878.394910:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788482878.394915:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072372992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482878.394943:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072372992:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482878.394949:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788482878.394975:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482878.394980:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482878.394983:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788482878.395026:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728d180 x1875360072372992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482878.395048:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072372992:0@lo:400:kworker.0 00010000:00080000:3.0:1788482878.395086:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728fb80 x1875360072372736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482878.395097:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072372736:0@lo:400:kworker.0 00000100:00100000:1.0:1788482878.398304:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072372608:0@lo:400:kworker.0 00000100:00100000:1.0:1788482878.398411:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482878.398707:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072372480 00000100:00100000:0.0:1788482878.398721:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072372480 00000100:00100000:0.0:1788482878.398793:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072372608 00000100:00100000:0.0:1788482878.398796:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072372608 00000100:00100000:0.0:1788482878.398834:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482878.398853:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072372480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482878.398932:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072372480:12345-0@lo:400:kworker.0 Request processed in 83us (4426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482878.398939:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482878.398960:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788482878.398965:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072372608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482878.398990:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072372608:12345-0@lo:400:kworker.0 Request processed in 25us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482878.398995:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788482878.404180:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072372608:0@lo:400:kworker.0 00000100:00080000:3.0:1788482878.408460:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482878.408555:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072372480:0@lo:400:kworker.0 00000100:00100000:2.0:1788482878.903578:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482878.903623:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072373120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482878.903796:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482878.904066:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072373120 00000100:00100000:1.0:1788482878.904082:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072373120 00000100:00100000:0.0:1788482878.904326:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788482878.904344:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072373120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788482878.904399:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482878.904472:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072373120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482878.904480:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788482878.904912:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93728d500 x1875360072373120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482878.904937:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072373120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788482879.347668:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482879.922567:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482879.922612:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072373248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788482879.922735:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482879.922914:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072373248 00000100:00100000:0.0:1788482879.922928:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072373248 00000100:00100000:0.0:1788482879.923025:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788482879.923039:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072373248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482879.923101:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482879.923169:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072373248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482879.923177:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788482879.923244:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93ff52d80 x1875360072373248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482895 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482879.923292:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072373248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788482880.382175:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482881.394456:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482881.509760:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482881.509963:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063954432 00000100:00100000:3.0:1788482881.509985:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063954432 00000100:00100000:1.0:1788482881.510004:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482881.510067:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482881.510125:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482881.510167:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063954560 00000100:00100000:3.0:1788482881.510176:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063954560 00000100:00100000:1.0:1788482881.510201:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063954176 00000100:00100000:1.0:1788482881.510218:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063954176 00000100:00100000:1.0:1788482881.510352:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00080000:0.0:1788482881.510383:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482881.510390:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482881.510421:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2353:x1875360063954176:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482881.510421:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788482881.510443:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:2350:x1875360063954432:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:0.0:1788482881.510508:0:6660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78b0d 00000100:00080000:0.0:1788482881.510530:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb92163f000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788482881.510570:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2353:x1875360063954176:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 172us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482881.510585:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 194 00000001:00000004:0.0:1788482881.510615:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788482881.511245:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+2:2350:x1875360063954432:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 806us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482881.511456:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788482881.511508:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063954304 00000100:00100000:0.0:1788482881.511519:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063954304 00000100:00100000:0.0:1788482881.511587:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:0.0:1788482881.511597:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063954304:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482881.511638:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063954304:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 44us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482881.511645:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00010000:00010000:0.0:1788482881.511737:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788482881.511845:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482881.511926:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:3.0:1788482881.511937:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2350:x1875360063954560:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:3.0:1788482881.511966:0:6662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78b14 00000100:00080000:3.0:1788482881.511976:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9eb92163b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788482881.512019:0:6662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788482881.512389:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482881.512507:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+2:2350:x1875360063954560:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 571us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482881.512516:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000001:00100000:1.0:1788482882.046237:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:1.0:1788482882.046274:0:6686:0:(genops.c:885:class_export_put()) final put ffff9eb92163e800/aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:0.0:1788482882.046370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92163e800/aa30c745-265d-4a44-8753-67e411452897 for lustre-OST0000 00000020:00000080:0.0:1788482882.046428:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb92163f000 for lustre-OST0000 00000001:02000400:3.0:1788482882.123658:0:9036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing yml_node 00010000:00010000:3.0:1788482882.419453:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482883.442479:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482883.511484:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072373760:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.511576:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482883.511638:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788482883.511644:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072373376:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.511674:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482883.511699:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072373888:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.511723:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482883.511747:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072373504:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.511782:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482883.511799:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072374016:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.511820:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482883.511838:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482883.511843:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.511863:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482883.511892:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072373760 00000100:00100000:0.0:1788482883.511900:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072373760 00000100:00100000:0.0:1788482883.511951:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072374016 00000100:00100000:0.0:1788482883.511954:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072374016 00000100:00100000:0.0:1788482883.511972:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788482883.511981:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072373760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512031:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072373760:12345-0@lo:400:kworker.0 Request processed in 50us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482883.512038:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788482883.512063:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482883.512069:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072374016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512101:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072374016:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482883.512108:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482883.512125:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072373376 00000100:00100000:0.0:1788482883.512129:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072373376 00000100:00100000:0.0:1788482883.512173:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788482883.512180:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072373376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512208:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072373376:12345-0@lo:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482883.512215:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788482883.512240:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072373888 00000100:00100000:0.0:1788482883.512243:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072373888 00000100:00100000:0.0:1788482883.512291:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072373504 00000100:00100000:0.0:1788482883.512294:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072373504 00000100:00100000:0.0:1788482883.512303:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072373632 00000100:00100000:0.0:1788482883.512306:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072373632 00000100:00100000:0.0:1788482883.512318:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788482883.512324:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072373888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512352:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072373888:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482883.512358:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788482883.512368:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788482883.512374:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072373504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512396:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072373504:12345-0@lo:400:kworker.0 Request processed in 23us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482883.512412:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788482883.512423:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788482883.512428:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072373632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512454:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072373632:12345-0@lo:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482883.512460:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788482883.512484:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788482883.512489:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482883.512491:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482883.512523:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512534:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072373504:0@lo:400:kworker.0 00010000:00080000:0.0:1788482883.512546:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92ec5b100 x1875360072374016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482883.512557:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072374016:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512583:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072373376:0@lo:400:kworker.0 00000100:00100000:0.0:1788482883.512592:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072373888:0@lo:400:kworker.0 00010000:00080000:0.0:1788482883.512602:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93ff50000 x1875360072373760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482883.512610:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072373760:0@lo:400:kworker.0 00000100:00100000:3.0:1788482884.018675:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072374144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482884.018782:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482884.018918:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072374144 00000100:00100000:1.0:1788482884.018934:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072374144 00000100:00100000:1.0:1788482884.019018:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788482884.019033:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072374144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482884.019089:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482884.019180:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072374144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482884.019188:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788482884.019313:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb46d80 x1875360072374144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482884.019336:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072374144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788482884.466422:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482885.042558:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482885.042595:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072374272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482885.042705:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482885.042843:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072374272 00000100:00100000:0.0:1788482885.042853:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072374272 00000100:00100000:0.0:1788482885.042921:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788482885.042932:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072374272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482885.042974:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482885.043027:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072374272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482885.043035:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788482885.043061:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482885.043095:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e0ea00 x1875360072374272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482885.043116:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072374272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788482885.493740:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788482885.730113:0:9227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.84 00000001:00100000:0.0:1788482886.138388:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:0.0:1788482886.138398:0:7620:0:(genops.c:885:class_export_put()) final put ffff9eb921639000/aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:1.0:1788482886.138464:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb921639000/aa30c745-265d-4a44-8753-67e411452897 for lustre-OST0001 00000020:00000080:1.0:1788482886.138536:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb92163b800 for lustre-OST0001 00010000:00010000:0.0:1788482886.514554:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482886.622071:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482886.622173:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482886.622276:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063954688 00000100:00100000:1.0:1788482886.622288:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063954688 00000100:00100000:1.0:1788482886.622344:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:1.0:1788482886.622355:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2353:x1875360063954688:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482886.622435:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2353:x1875360063954688:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482886.622442:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:2.0:1788482886.629374:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063954816 00000100:00100000:2.0:1788482886.629391:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063954816 00000100:00100000:2.0:1788482886.629481:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:2.0:1788482886.629493:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063954816:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482886.629568:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063954816:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 78us (7510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482886.629576:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00080000:3.0:1788482886.633939:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788482887.538632:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788482888.264039:0:9328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.84 00010000:00010000:0.0:1788482888.565554:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482888.626803:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482888.626836:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072374400:0@lo:400:kworker.0 00000100:00100000:1.0:1788482888.626949:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482888.627085:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072374400 00000100:00100000:2.0:1788482888.627096:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072374400 00000100:00100000:2.0:1788482888.627163:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788482888.627174:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072374400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482888.627236:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072374400:12345-0@lo:400:kworker.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482888.627245:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788482888.627366:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072374400:0@lo:400:kworker.0 00000100:00100000:2.0:1788482888.627690:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788482888.627904:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482888.627917:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072374656:0@lo:400:kworker.0 00000100:00100000:1.0:1788482888.627955:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482888.629695:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072374656 00000100:00100000:0.0:1788482888.629722:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072374656 00000100:00100000:0.0:1788482888.629840:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788482888.629855:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072374656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482888.629952:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072374656:12345-0@lo:400:kworker.0 Request processed in 102us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482888.629959:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788482888.630125:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482888.630165:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072374656:0@lo:400:kworker.0 00000100:00100000:2.0:1788482888.631029:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072374528:0@lo:400:kworker.0 00000100:00100000:2.0:1788482888.631094:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482888.631244:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072374528 00000100:00100000:0.0:1788482888.631266:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072374528 00000100:00100000:0.0:1788482888.631323:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788482888.631334:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072374528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482888.631435:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072374528:12345-0@lo:400:kworker.0 Request processed in 103us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482888.631444:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788482888.631773:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072374528:0@lo:400:kworker.0 00000100:00100000:1.0:1788482888.632137:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072374784:0@lo:400:kworker.0 00000100:00100000:1.0:1788482888.632206:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482888.632338:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072374784 00000100:00100000:0.0:1788482888.632345:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072374784 00000100:00100000:0.0:1788482888.632409:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788482888.632417:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072374784:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788482888.632554:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482888.632735:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072374784:12345-0@lo:400:kworker.0 Request processed in 317us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482888.632745:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788482888.632870:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072375040:0@lo:400:kworker.0 00000100:00100000:0.0:1788482888.632913:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482888.632976:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072375040 00000100:00100000:2.0:1788482888.632987:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072375040 00000100:00100000:2.0:1788482888.633023:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482888.633030:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072375040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482888.633164:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072374912:0@lo:400:kworker.0 00000100:00100000:3.0:1788482888.633205:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482888.633270:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072374912 00000100:00100000:3.0:1788482888.633274:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072374912 00000100:00100000:3.0:1788482888.633306:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788482888.633314:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072374912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482888.633348:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072374912:12345-0@lo:400:kworker.0 Request processed in 35us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482888.633355:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788482888.633392:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072374912:0@lo:400:kworker.0 00000100:00080000:3.0:1788482888.633433:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482888.633437:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788482888.633518:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937266680 x1875360072374784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482888.633617:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072374784:0@lo:400:kworker.0 00000100:00100000:2.0:1788482888.633747:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072375040:12345-0@lo:400:kworker.0 Request processed in 717us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482888.633755:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788482888.633802:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93704e300 x1875360072375040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482888.633812:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072375040:0@lo:400:kworker.0 00000100:00100000:2.0:1788482889.145015:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072375168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482889.145123:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482889.145605:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072375168 00000100:00100000:1.0:1788482889.145624:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072375168 00000100:00100000:1.0:1788482889.145712:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788482889.145724:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072375168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482889.145778:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482889.146873:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072375168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1142us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482889.146889:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788482889.152198:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb46300 x1875360072375168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482889.152236:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072375168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482889.586521:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482890.162456:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482890.162486:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072375296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482890.162606:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482890.162796:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072375296 00000100:00100000:0.0:1788482890.162809:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072375296 00000100:00100000:0.0:1788482890.162961:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788482890.162974:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072375296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482890.163031:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482890.163098:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072375296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482890.163107:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788482890.163135:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788482890.163174:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e0f480 x1875360072375296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482890.163196:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072375296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788482890.612339:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788482891.295786:0:9425:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.84 00010000:00010000:0.0:1788482891.639945:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482891.741089:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482891.741161:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482891.741357:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063955072 00000100:00100000:2.0:1788482891.741378:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063955072 00000100:00100000:2.0:1788482891.741523:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:2.0:1788482891.741541:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063955072:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482891.741716:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063955072:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 180us (553us total) trans 0 rc 0/0 00000100:00080000:1.0:1788482891.741730:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482891.741731:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1788482891.744810:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063954944 00000100:00100000:0.0:1788482891.744849:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063954944 00000100:00100000:0.0:1788482891.744959:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 198 00000100:00100000:0.0:1788482891.744981:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2353:x1875360063954944:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482891.745134:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2353:x1875360063954944:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 155us (4060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482891.745150:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 198 00010000:00010000:0.0:1788482892.662167:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788482893.649394:0:9474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 3 20:48:11 EDT 2026 00010000:00010000:3.0:1788482893.686019:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482893.750581:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072375808:0@lo:400:kworker.0 00000100:00100000:0.0:1788482893.751009:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072375424:0@lo:400:kworker.0 00000100:00100000:0.0:1788482893.751137:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482893.751222:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482893.751336:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072375552:0@lo:400:kworker.0 00000100:00100000:2.0:1788482893.751367:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482893.751383:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072376064:0@lo:400:kworker.0 00000100:00100000:0.0:1788482893.751763:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072375936:0@lo:400:kworker.0 00000100:00100000:0.0:1788482893.751788:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482893.751820:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072375424 00000100:00100000:3.0:1788482893.751910:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072375552 00000100:00100000:3.0:1788482893.751921:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072375552 00000100:00100000:3.0:1788482893.751983:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072375936 00000100:00100000:3.0:1788482893.751987:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072375936 00000100:00100000:0.0:1788482893.752003:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072375424 00000100:00100000:3.0:1788482893.752054:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788482893.752069:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072375552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482893.752101:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788482893.752111:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072375424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482893.752169:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072375552:12345-0@lo:400:kworker.0 Request processed in 104us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482893.752178:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788482893.752198:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788482893.752205:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072375936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482893.752231:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482893.752511:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072375552:0@lo:400:kworker.0 00000100:00100000:2.0:1788482893.752529:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482893.752535:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072375680:0@lo:400:kworker.0 00000100:00100000:2.0:1788482893.752556:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482893.752593:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072375808 00000100:00100000:2.0:1788482893.752597:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072375808 00000100:00100000:2.0:1788482893.752627:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072376064 00000100:00100000:2.0:1788482893.752630:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072376064 00000100:00100000:2.0:1788482893.752644:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482893.752649:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072375808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482893.752708:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072375424:12345-0@lo:400:kworker.0 Request processed in 598us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482893.752720:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788482893.752824:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072375936:12345-0@lo:400:kworker.0 Request processed in 618us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482893.752853:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788482893.752875:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072375680 00000100:00100000:3.0:1788482893.752878:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072375680 00000100:00100000:3.0:1788482893.752895:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788482893.752901:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072375680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482893.752940:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072375680:12345-0@lo:400:kworker.0 Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482893.752947:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788482893.752969:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072375424:0@lo:400:kworker.0 00000100:00080000:3.0:1788482893.752970:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482893.752978:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482893.752983:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482893.752990:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072375936:0@lo:400:kworker.0 00000100:00100000:2.0:1788482893.753531:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072375808:12345-0@lo:400:kworker.0 Request processed in 880us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482893.753540:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482893.753558:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788482893.753566:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072376064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482893.753606:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072376064:12345-0@lo:400:kworker.0 Request processed in 42us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482893.753612:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788482893.753650:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072375680:0@lo:400:kworker.0 00010000:00080000:2.0:1788482893.753786:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb45c00 x1875360072376064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482893.753798:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072376064:0@lo:400:kworker.0 00010000:00080000:3.0:1788482893.753947:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb44a80 x1875360072375808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482893.753959:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072375808:0@lo:400:kworker.0 00000100:00100000:1.0:1788482894.262745:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482894.262783:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072376192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482894.262900:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482894.264602:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072376192 00000100:00100000:0.0:1788482894.264619:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072376192 00000100:00100000:0.0:1788482894.264708:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788482894.264721:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072376192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788482894.264773:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482894.264875:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072376192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482894.264884:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788482894.264942:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb45c00 x1875360072376192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482894.264966:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072376192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482894.706463:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482895.282559:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482895.282584:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072376320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482895.282663:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482895.282810:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072376320 00000100:00100000:0.0:1788482895.282821:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072376320 00000100:00100000:0.0:1788482895.282897:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788482895.282911:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072376320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482895.282957:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482895.283007:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072376320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482895.283015:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788482895.283059:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e0d180 x1875360072376320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482895.283090:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072376320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788482895.283214:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788482895.735811:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482896.757448:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482896.859118:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482896.864684:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482896.864734:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063955328 00000100:00100000:3.0:1788482896.864744:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063955328 00000100:00100000:3.0:1788482896.864821:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:3.0:1788482896.864835:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063955328:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482896.864915:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063955328:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 83us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482896.864923:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00080000:3.0:1788482896.864951:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482896.868853:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063955200 00000100:00100000:0.0:1788482896.868870:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063955200 00000100:00100000:0.0:1788482896.868927:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:0.0:1788482896.868938:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2351:x1875360063955200:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482896.869018:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2351:x1875360063955200:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 82us (9910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482896.869026:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 200 00010000:00010000:2.0:1788482897.795590:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482898.802421:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482898.866587:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072376448:0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.866679:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482898.866825:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072376576:0@lo:400:kworker.0 00000100:00100000:1.0:1788482898.866860:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482898.866921:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072377088:0@lo:400:kworker.0 00000100:00100000:1.0:1788482898.866947:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482898.867638:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072376960:0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.867668:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482898.867687:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482898.867694:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072376832:0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.867718:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482898.867750:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072377088 00000100:00100000:0.0:1788482898.867758:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072377088 00000100:00100000:0.0:1788482898.867813:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072376832 00000100:00100000:0.0:1788482898.867817:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072376832 00000100:00100000:0.0:1788482898.867835:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788482898.867843:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072377088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.867889:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072377088:12345-0@lo:400:kworker.0 Request processed in 46us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482898.867896:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788482898.867914:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788482898.867933:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072376832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.867970:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072376832:12345-0@lo:400:kworker.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482898.867976:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788482898.868002:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788482898.868005:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788482898.868033:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b8a80 x1875360072376832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482898.868047:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072376832:0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.868179:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072376704:0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.868206:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482898.868242:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072376576 00000100:00100000:0.0:1788482898.868246:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072376576 00000100:00100000:0.0:1788482898.868291:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072376960 00000100:00100000:0.0:1788482898.868295:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072376960 00000100:00100000:0.0:1788482898.868311:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072376704 00000100:00100000:0.0:1788482898.868314:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072376704 00000100:00100000:0.0:1788482898.868327:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788482898.868333:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072376576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.868366:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072376576:12345-0@lo:400:kworker.0 Request processed in 33us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482898.868372:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788482898.868384:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788482898.868390:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072376960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.868417:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072376960:12345-0@lo:400:kworker.0 Request processed in 28us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482898.868433:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788482898.868445:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788482898.868451:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072376704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.868495:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072376704:12345-0@lo:400:kworker.0 Request processed in 32us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482898.868501:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788482898.868516:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482898.868534:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072376704:0@lo:400:kworker.0 00000100:00100000:0.0:1788482898.868557:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072376960:0@lo:400:kworker.0 00010000:00080000:1.0:1788482898.870739:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b9c00 x1875360072377088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482898.870758:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072377088:0@lo:400:kworker.0 00000100:00100000:1.0:1788482898.870796:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072376576:0@lo:400:kworker.0 00000100:00100000:2.0:1788482898.871506:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072376448 00000100:00100000:2.0:1788482898.871532:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072376448 00000100:00100000:2.0:1788482898.871595:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788482898.871605:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072376448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482898.871768:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072376448:12345-0@lo:400:kworker.0 Request processed in 164us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482898.871776:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788482898.871931:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072376448:0@lo:400:kworker.0 00000100:00100000:0.0:1788482899.378539:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072377216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482899.378630:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482899.379216:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072377216 00000100:00100000:2.0:1788482899.379225:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072377216 00000100:00100000:2.0:1788482899.379303:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482899.379315:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072377216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788482899.379352:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482899.379413:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072377216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482899.379420:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788482899.379843:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb44700 x1875360072377216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482899.379864:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072377216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788482899.827605:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482900.403378:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482900.403426:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072377344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482900.403531:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482900.403637:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072377344 00000100:00100000:0.0:1788482900.403650:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072377344 00000100:00100000:0.0:1788482900.404946:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788482900.404958:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072377344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482900.405060:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482900.405136:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072377344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482900.405143:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788482900.405324:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e0f100 x1875360072377344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482900.405358:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072377344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788482900.405523:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788482900.850602:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482901.874511:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482901.989143:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482901.989199:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482901.989290:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063955456 00000100:00100000:1.0:1788482901.989301:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063955456 00000100:00100000:1.0:1788482901.989354:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:1.0:1788482901.989365:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2351:x1875360063955456:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482901.989474:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2351:x1875360063955456:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 111us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482901.989483:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:1.0:1788482901.989619:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063955584 00000100:00100000:1.0:1788482901.989635:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063955584 00000100:00100000:1.0:1788482901.989682:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1788482901.989689:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063955584:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482901.989739:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063955584:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 49us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482901.989745:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00080000:1.0:1788482901.989762:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788482902.915362:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482903.928547:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482903.986534:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072377600:0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.986606:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482903.986667:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072378112:0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.986693:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482903.986728:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482903.986734:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072377728:0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.986759:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482903.986794:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072377600 00000100:00100000:1.0:1788482903.986802:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072377600 00000100:00100000:1.0:1788482903.986845:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072377728 00000100:00100000:1.0:1788482903.986848:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072377728 00000100:00100000:1.0:1788482903.986876:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788482903.986885:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072377600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.986948:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072377600:12345-0@lo:400:kworker.0 Request processed in 63us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482903.986969:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788482903.986986:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788482903.986992:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.987022:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072377728:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482903.987028:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788482903.987082:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072378112 00000100:00100000:1.0:1788482903.987086:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072378112 00000100:00100000:1.0:1788482903.987117:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788482903.987123:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072378112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.987154:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072378112:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482903.987159:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788482903.987181:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482903.987185:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482903.987216:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072377728:0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.987225:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072377600:0@lo:400:kworker.0 00010000:00080000:1.0:1788482903.987235:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b8000 x1875360072378112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482903.987244:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072378112:0@lo:400:kworker.0 00000100:00100000:0.0:1788482903.987428:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072377472:0@lo:400:kworker.0 00000100:00100000:0.0:1788482903.987460:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482903.987493:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072377984:0@lo:400:kworker.0 00000100:00100000:0.0:1788482903.987514:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482903.987534:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482903.987540:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072377856:0@lo:400:kworker.0 00000100:00100000:0.0:1788482903.987561:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482903.987585:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072377856 00000100:00100000:0.0:1788482903.987588:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072377856 00000100:00100000:0.0:1788482903.987617:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788482903.987624:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072377856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482903.987659:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072377856:12345-0@lo:400:kworker.0 Request processed in 36us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482903.987665:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788482903.987693:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b9f80 x1875360072377856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482903.987702:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072377856:0@lo:400:kworker.0 00000100:00100000:0.0:1788482903.987718:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072377984 00000100:00100000:0.0:1788482903.987720:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072377984 00000100:00100000:0.0:1788482903.987741:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788482903.987747:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072377984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482903.987792:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072377984:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482903.987798:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788482903.987823:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072377984:0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.987998:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072377472 00000100:00100000:1.0:1788482903.988003:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072377472 00000100:00100000:1.0:1788482903.988043:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788482903.988050:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072377472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482903.988097:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072377472:12345-0@lo:400:kworker.0 Request processed in 47us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482903.988103:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1788482903.988128:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788482903.988131:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482903.988145:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072377472:0@lo:400:kworker.0 00000100:00100000:1.0:1788482904.516402:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072378240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482904.516513:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482904.518225:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072378240 00000100:00100000:2.0:1788482904.518246:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072378240 00000100:00100000:2.0:1788482904.518376:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788482904.518399:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072378240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788482904.518436:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482904.518516:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072378240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482904.518524:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788482904.518569:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb45f80 x1875360072378240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482904.518601:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072378240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788482904.946532:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482905.522665:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072378368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482905.522777:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482905.522953:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072378368 00000100:00100000:3.0:1788482905.522962:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072378368 00000100:00100000:3.0:1788482905.523034:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788482905.523044:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072378368:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788482905.523047:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788482905.523083:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482905.534096:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072378368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10361us (10626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482905.534115:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788482905.546640:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e0ed80 x1875360072378368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482905.546671:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072378368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788482905.976568:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482906.995399:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482907.102633:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482907.103783:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063955840 00000100:00100000:0.0:1788482907.103796:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063955840 00000100:00100000:0.0:1788482907.103907:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:0.0:1788482907.103921:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063955840:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482907.104000:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063955840:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 83us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482907.104007:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00080000:3.0:1788482907.109893:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482907.114318:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482907.115025:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063955712 00000100:00100000:3.0:1788482907.115038:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063955712 00000100:00100000:3.0:1788482907.115106:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:3.0:1788482907.115118:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2354:x1875360063955712:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482907.115223:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2354:x1875360063955712:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 106us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482907.115231:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 204 00010000:00010000:0.0:1788482908.027319:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482909.044528:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482909.109547:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072378496:0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.109667:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482909.109736:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072379008:0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.109783:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482909.109791:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072378624:0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.109822:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788482909.109831:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072378880:0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.110756:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482909.110804:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072378752:0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.110868:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482909.110914:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072378496 00000100:00100000:0.0:1788482909.110925:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072378496 00000100:00100000:0.0:1788482909.110985:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788482909.111002:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072378496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.111065:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072378496:12345-0@lo:400:kworker.0 Request processed in 65us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482909.111074:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788482909.111120:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072379008 00000100:00100000:0.0:1788482909.111124:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072379008 00000100:00100000:0.0:1788482909.111158:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072378752 00000100:00100000:0.0:1788482909.111162:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072378752 00000100:00100000:0.0:1788482909.111181:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788482909.111188:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072379008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.111224:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072379008:12345-0@lo:400:kworker.0 Request processed in 36us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482909.111231:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788482909.111244:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788482909.111269:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072378752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.111302:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072378752:12345-0@lo:400:kworker.0 Request processed in 35us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482909.111321:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788482909.111342:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072378880 00000100:00100000:0.0:1788482909.111346:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072378880 00000100:00100000:0.0:1788482909.111387:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788482909.111395:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072378880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.111427:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072378880:12345-0@lo:400:kworker.0 Request processed in 33us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482909.111434:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788482909.111479:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93ff50000 x1875360072378880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482909.111509:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072378880:0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.111524:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072378496:0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.111536:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072379008:0@lo:400:kworker.0 00000100:00080000:0.0:1788482909.114474:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788482909.114489:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482909.114595:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072378752:0@lo:400:kworker.0 00000100:00100000:3.0:1788482909.115929:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482909.116166:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072379136:0@lo:400:kworker.0 00000100:00100000:3.0:1788482909.116230:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482909.117059:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072378624 00000100:00100000:0.0:1788482909.117075:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072378624 00000100:00100000:0.0:1788482909.117152:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788482909.117167:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072378624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.117300:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072378624:12345-0@lo:400:kworker.0 Request processed in 137us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482909.117321:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788482909.117356:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072379136 00000100:00100000:0.0:1788482909.117360:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072379136 00000100:00100000:0.0:1788482909.117394:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788482909.117401:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072379136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482909.117442:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072379136:12345-0@lo:400:kworker.0 Request processed in 42us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482909.117449:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788482909.117477:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788482909.117514:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072378624:0@lo:400:kworker.0 00010000:00080000:3.0:1788482909.117691:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93ff51880 x1875360072379136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482909.117706:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072379136:0@lo:400:kworker.0 00000100:00100000:1.0:1788482909.625529:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482909.625550:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072379264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482909.625622:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482909.625685:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072379264 00000100:00100000:1.0:1788482909.625692:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072379264 00000100:00100000:1.0:1788482909.625734:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788482909.625743:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072379264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482909.625780:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482909.625830:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072379264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482909.625837:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788482909.625872:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b8000 x1875360072379264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482909.625889:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072379264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482910.068489:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482910.646024:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482910.646059:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072379392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482910.646120:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482910.646195:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072379392 00000100:00100000:1.0:1788482910.646201:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072379392 00000100:00100000:1.0:1788482910.646243:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788482910.646273:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072379392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482910.646315:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482910.646363:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072379392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482910.646370:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788482910.646405:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb44700 x1875360072379392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482910.646422:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072379392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482911.093846:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482912.114552:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482912.221622:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482912.221663:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482912.221964:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063955968 00000100:00100000:1.0:1788482912.221977:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063955968 00000100:00100000:1.0:1788482912.222023:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:1.0:1788482912.222032:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2353:x1875360063955968:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482912.222104:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2353:x1875360063955968:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 72us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482912.222112:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:3.0:1788482912.222279:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063956096 00000100:00100000:3.0:1788482912.222284:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063956096 00000100:00100000:3.0:1788482912.222325:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:3.0:1788482912.222334:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063956096:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482912.222367:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063956096:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482912.222373:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00080000:3.0:1788482912.222396:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788482913.138851:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482914.162569:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482914.226575:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072379776:0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.226675:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482914.226768:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788482914.226774:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072379648:0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.226797:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482914.226813:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072380160:0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.226836:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482914.226874:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072379776 00000100:00100000:0.0:1788482914.226884:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072379776 00000100:00100000:0.0:1788482914.226941:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072379648 00000100:00100000:0.0:1788482914.226943:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072379648 00000100:00100000:0.0:1788482914.226967:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788482914.226976:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072379776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.227031:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072379776:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482914.227038:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788482914.227056:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788482914.227061:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072379648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.227083:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072379648:12345-0@lo:400:kworker.0 Request processed in 22us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482914.227089:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788482914.227109:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072380160 00000100:00100000:0.0:1788482914.227112:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072380160 00000100:00100000:0.0:1788482914.227137:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788482914.227144:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072380160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.227170:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072380160:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482914.227191:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788482914.227208:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482914.227212:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482914.227297:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072379648:0@lo:400:kworker.0 00010000:00080000:0.0:1788482914.227312:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93fe50000 x1875360072380160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482914.227323:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072380160:0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.227332:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072379776:0@lo:400:kworker.0 00000100:00100000:3.0:1788482914.227518:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072379904:0@lo:400:kworker.0 00000100:00100000:3.0:1788482914.227550:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482914.227575:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788482914.227581:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072379520:0@lo:400:kworker.0 00000100:00100000:3.0:1788482914.227611:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482914.227635:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072380032:0@lo:400:kworker.0 00000100:00100000:3.0:1788482914.227658:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482914.227809:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072379904 00000100:00100000:0.0:1788482914.227814:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072379904 00000100:00100000:0.0:1788482914.227975:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482914.227983:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072379904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.228021:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072379904:12345-0@lo:400:kworker.0 Request processed in 39us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482914.228028:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788482914.228048:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072379520 00000100:00100000:0.0:1788482914.228051:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072379520 00000100:00100000:0.0:1788482914.228074:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788482914.228080:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072379520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.228106:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072379520:12345-0@lo:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482914.228112:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788482914.228148:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072379520:0@lo:400:kworker.0 00010000:00080000:0.0:1788482914.228158:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93fe51f80 x1875360072379904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482914.228178:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072379904:0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.228195:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072380032 00000100:00100000:0.0:1788482914.228198:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072380032 00000100:00100000:0.0:1788482914.228233:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788482914.228239:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072380032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482914.228289:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072380032:12345-0@lo:400:kworker.0 Request processed in 50us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482914.228295:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788482914.228318:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072380032:0@lo:400:kworker.0 00000100:00080000:3.0:1788482914.228681:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788482914.228686:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788482914.738978:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482914.739012:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072380288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482914.739119:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482914.739190:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072380288 00000100:00100000:2.0:1788482914.739201:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072380288 00000100:00100000:2.0:1788482914.739292:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788482914.739306:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072380288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788482914.739347:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482914.767821:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072380288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 28507us (28689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482914.767840:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788482914.767990:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb45c00 x1875360072380288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482914.768018:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072380288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788482915.189614:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788482915.671855:0:10104:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:48:33 (1788482913) === 00000100:00100000:1.0:1788482915.762660:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788482915.762688:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072380416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482915.762775:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482915.763064:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072380416 00000100:00100000:2.0:1788482915.763074:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072380416 00000100:00100000:2.0:1788482915.763130:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788482915.763141:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072380416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482915.763182:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482915.763238:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072380416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482915.763246:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788482915.763692:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb45c00 x1875360072380416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482915.764527:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072380416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788482916.211175:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482916.272465:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482916.313690:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063956224 00000100:00100000:2.0:1788482916.313710:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063956224 00000100:00100000:3.0:1788482916.316618:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:3.0:1788482916.316652:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:8123:x1875360063956224:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788482916.316679:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482916.316706:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492600/0x42820277aad78bd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe707792e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.316760:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492600/0x42820277aad78bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707792e expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.316848:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492600/0x42820277aad78bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707792e expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.316860:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492600, rc 0) 00000100:00100000:3.0:1788482916.316950:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8123:x1875360063956224:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 304us (44499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.316958:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:1.0:1788482916.323341:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482916.323935:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063956352 00000100:00100000:0.0:1788482916.323955:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063956352 00000100:00100000:0.0:1788482916.324100:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:0.0:1788482916.324113:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8123:x1875360063956352:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788482916.346327:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8123:x1875360063956352:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 22204us (23240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.346343:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:3.0:1788482916.350836:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482916.350933:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063956480 00000100:00100000:1.0:1788482916.350947:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063956480 00000100:00100000:1.0:1788482916.351026:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:1.0:1788482916.351040:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8123:x1875360063956480:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788482916.363078:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8123:x1875360063956480:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 12018us (12235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.363112:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:3.0:1788482916.382063:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482916.382732:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063956608 00000100:00100000:0.0:1788482916.382748:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063956608 00000100:00100000:1.0:1788482916.382945:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:1.0:1788482916.382959:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8127:x1875360063956608:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788482916.383819:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8127:x1875360063956608:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 859us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.383829:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:1.0:1788482916.411973:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482916.412080:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063956736 00000100:00100000:3.0:1788482916.412095:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063956736 00000100:00100000:3.0:1788482916.412189:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:3.0:1788482916.412202:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8127:x1875360063956736:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788482916.412634:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8127:x1875360063956736:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 433us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.412650:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:3.0:1788482916.429214:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482916.436167:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063956864 00000100:00100000:1.0:1788482916.436198:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063956864 00000100:00100000:1.0:1788482916.436301:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:1.0:1788482916.436322:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:8123:x1875360063956864:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788482916.436346:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482916.436370:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f627800/0x42820277aad78bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077958 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.436421:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f627800/0x42820277aad78bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077958 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.436434:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f627800/0x42820277aad78bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077958 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482916.436464:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627800, rc 0) 00000100:00100000:1.0:1788482916.436566:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:8123:x1875360063956864:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 247us (8330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.436574:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:0.0:1788482916.439856:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482916.439948:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063956992 00000100:00100000:2.0:1788482916.439960:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063956992 00000100:00100000:2.0:1788482916.440024:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:2.0:1788482916.440035:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:8123:x1875360063956992:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788482916.440065:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788482916.440094:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788482916.440098:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788482916.440101:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788482916.440104:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788482916.450098:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:8123:x1875360063956992:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 10039us (10230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.450118:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:0.0:1788482916.459711:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482916.459824:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063957120 00000100:00100000:3.0:1788482916.459837:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063957120 00000100:00100000:3.0:1788482916.459949:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:3.0:1788482916.459963:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:8123:x1875360063957120:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788482916.459995:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482916.460024:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe707795f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.460061:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.460074:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482916.460085:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493400, rc 0) 00000100:00100000:3.0:1788482916.460346:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8123:x1875360063957120:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 384us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.460354:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:2.0:1788482916.463793:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482916.463899:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063957248 00000100:00100000:0.0:1788482916.463911:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063957248 00000100:00100000:0.0:1788482916.464164:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:0.0:1788482916.464186:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8123:x1875360063957248:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788482916.464914:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8123:x1875360063957248:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 737us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.464925:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:2.0:1788482916.467653:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482916.467732:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063957376 00000100:00100000:0.0:1788482916.467744:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063957376 00000100:00100000:0.0:1788482916.467865:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:0.0:1788482916.467878:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8123:x1875360063957376:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788482916.468192:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8123:x1875360063957376:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 315us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.468201:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:2.0:1788482916.472062:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482916.472346:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063957504 00000100:00100000:1.0:1788482916.472359:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063957504 00000100:00100000:1.0:1788482916.472431:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:1.0:1788482916.472442:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8133:x1875360063957504:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788482916.472920:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8133:x1875360063957504:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 479us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.472930:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:2.0:1788482916.489580:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482916.489679:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063957632 00000100:00100000:3.0:1788482916.489695:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063957632 00000100:00100000:3.0:1788482916.489778:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:3.0:1788482916.489791:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8133:x1875360063957632:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788482916.490134:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:8133:x1875360063957632:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 344us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.490152:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:2.0:1788482916.508607:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482916.508656:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482916.508830:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063957760 00000100:00100000:3.0:1788482916.508843:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063957760 00000100:00100000:3.0:1788482916.508898:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063958144 00000100:00100000:3.0:1788482916.508900:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063958144 00000100:00100000:3.0:1788482916.508965:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:3.0:1788482916.508988:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063958144:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482916.509104:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063958144:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 129us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.509119:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:3.0:1788482916.509148:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788482916.509154:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875360063957760:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788482916.509194:0:5806:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5778eeb0-8512-44ab-a78a-f60f28116302@192.168.201.6@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1788482916.509237:0:5806:0:(genops.c:1385:class_connect()) connect: client 5778eeb0-8512-44ab-a78a-f60f28116302, cookie 0x42820277aad78bed 00000004:00100000:3.0:1788482916.509302:0:5806:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788482916.511890:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788482916.516486:0:5806:0:(import.c:65:import_set_state_nolock()) ffff9eb93ff2f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482916.516604:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+6:2350:x1875360063957760:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 7445us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.516616:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:2.0:1788482916.529585:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482916.529638:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482916.529775:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063957888 00000100:00100000:0.0:1788482916.529791:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063957888 00000100:00100000:0.0:1788482916.529885:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063958016 00000100:00100000:0.0:1788482916.529889:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063958016 00000100:00100000:0.0:1788482916.529916:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788482916.529927:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+7:0:x1875360063957888:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788482916.529973:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788482916.530075:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1788482916.530227:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+7:8123:x1875360063958016:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788482916.530410:0:6958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788482916.530622:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+7:8123:x1875360063958016:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 531us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482916.530632:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00080000:2.0:1788482916.532108:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482916.535844:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482916.538798:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063958272 00000100:00100000:3.0:1788482916.538820:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063958272 00000100:00100000:0.0:1788482916.538832:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+7:0:x1875360063957888:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 8893us (9250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.538848:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788482916.538896:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788482916.538912:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+6:8123:x1875360063958272:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788482916.538969:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+6:8123:x1875360063958272:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 63us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.538990:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1788482916.544639:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482916.544690:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482916.544722:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482916.545037:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063958400 00000100:00100000:0.0:1788482916.545051:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063958400 00000100:00100000:0.0:1788482916.545110:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063958528 00000100:00100000:0.0:1788482916.545288:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063958528 00000100:00100000:0.0:1788482916.545360:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788482916.545372:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875360063958400:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788482916.545467:0:6660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5778eeb0-8512-44ab-a78a-f60f28116302@192.168.201.6@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:0.0:1788482916.545637:0:6660:0:(genops.c:1385:class_connect()) connect: client 5778eeb0-8512-44ab-a78a-f60f28116302, cookie 0x42820277aad78bf4 00002000:00100000:0.0:1788482916.545653:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5778eeb0-8512-44ab-a78a-f60f28116302/ffff9eb936e2a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788482916.545668:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:3.0:1788482916.545758:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063958656 00000100:00100000:3.0:1788482916.545764:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063958656 00000100:00100000:3.0:1788482916.545829:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788482916.545837:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5778eeb0-8512-44ab-a78a-f60f28116302+6:8123:x1875360063958656:12345-192.168.201.6@tcp:33:mount.lustre.0 00002000:00080000:0.0:1788482916.546866:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788482916.546909:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb936e2e800 : changing import state from RECOVER to FULL 00000004:00200000:1.0:1788482916.548396:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788482916.548872:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+6:2350:x1875360063958400:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 3494us (4174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.548885:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788482916.548925:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788482916.548932:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875360063958528:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788482916.548962:0:6660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5778eeb0-8512-44ab-a78a-f60f28116302@192.168.201.6@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:0.0:1788482916.549013:0:6660:0:(genops.c:1385:class_connect()) connect: client 5778eeb0-8512-44ab-a78a-f60f28116302, cookie 0x42820277aad78bfb 00002000:00100000:0.0:1788482916.549028:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5778eeb0-8512-44ab-a78a-f60f28116302/ffff9eb936e28800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788482916.549055:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788482916.549284:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788482916.549325:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb936e2a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482916.558319:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5778eeb0-8512-44ab-a78a-f60f28116302+6:8123:x1875360063958656:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 12451us (13665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482916.558349:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1788482916.570199:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+6:2350:x1875360063958528:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 21234us (25444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482916.570219:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000001:00100000:0.0:1788482916.847855:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5778eeb0-8512-44ab-a78a-f60f28116302 00000001:00100000:1.0:1788482916.849052:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5778eeb0-8512-44ab-a78a-f60f28116302 00010000:00010000:2.0:1788482917.234836:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788482917.917604:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5778eeb0-8512-44ab-a78a-f60f28116302 00010000:00010000:3.0:1788482918.258890:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482919.287481:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482919.348347:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072380672:0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.348421:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482919.348487:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072381184:0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.348529:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482919.348562:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482919.348569:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072380800:0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.348591:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482919.348621:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072380672 00000100:00100000:1.0:1788482919.348629:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072380672 00000100:00100000:1.0:1788482919.348669:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072380800 00000100:00100000:1.0:1788482919.348672:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072380800 00000100:00100000:1.0:1788482919.348702:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788482919.348711:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072380672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.348760:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072380672:12345-0@lo:400:kworker.0 Request processed in 50us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.348767:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788482919.348783:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788482919.348789:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072380800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.348815:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072380800:12345-0@lo:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.348821:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788482919.348838:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072381184 00000100:00100000:1.0:1788482919.348841:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072381184 00000100:00100000:1.0:1788482919.348868:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788482919.348887:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072381184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.348933:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072381184:12345-0@lo:400:kworker.0 Request processed in 58us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.348939:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788482919.348957:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482919.348961:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482919.349000:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072380800:0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.349010:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072380672:0@lo:400:kworker.0 00010000:00080000:1.0:1788482919.349021:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b8380 x1875360072381184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482919.349031:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072381184:0@lo:400:kworker.0 00000100:00100000:3.0:1788482919.349188:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072380544:0@lo:400:kworker.0 00000100:00100000:3.0:1788482919.349223:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482919.349277:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072381056:0@lo:400:kworker.0 00000100:00100000:3.0:1788482919.349299:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482919.349316:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482919.349323:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072380928:0@lo:400:kworker.0 00000100:00100000:3.0:1788482919.349343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482919.349405:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072380544 00000100:00100000:1.0:1788482919.349409:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072380544 00000100:00100000:1.0:1788482919.349443:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788482919.349450:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072380544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.349488:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072380544:12345-0@lo:400:kworker.0 Request processed in 38us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.349494:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788482919.349526:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072380544:0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.349543:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072381056 00000100:00100000:1.0:1788482919.349546:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072381056 00000100:00100000:1.0:1788482919.349570:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788482919.349576:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072381056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482919.349608:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072381056:12345-0@lo:400:kworker.0 Request processed in 32us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.349613:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788482919.349626:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482919.349642:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072381056:0@lo:400:kworker.0 00000100:00100000:0.0:1788482919.349724:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072380928 00000100:00100000:0.0:1788482919.349728:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072380928 00000100:00100000:0.0:1788482919.349768:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788482919.349774:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072380928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482919.349812:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072380928:12345-0@lo:400:kworker.0 Request processed in 39us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482919.349817:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788482919.349846:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1bb800 x1875360072380928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482919.349856:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072380928:0@lo:400:kworker.0 00000100:00080000:1.0:1788482919.350175:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482919.860973:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482919.860995:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072381312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482919.861070:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482919.861149:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072381312 00000100:00100000:1.0:1788482919.861157:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072381312 00000100:00100000:1.0:1788482919.861211:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788482919.861221:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072381312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482919.861276:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482919.861320:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072381312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482919.861328:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788482919.861367:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b9f80 x1875360072381312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482919.861385:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072381312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482920.307440:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482920.889306:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072381440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482920.889379:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482920.889480:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072381440 00000100:00100000:1.0:1788482920.889491:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072381440 00000100:00100000:1.0:1788482920.889555:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788482920.889567:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072381440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482920.889608:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482920.889653:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072381440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482920.889660:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788482920.889701:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b9f80 x1875360072381440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482920.889718:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072381440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788482921.330444:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482921.947984:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482921.948038:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482921.948096:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482921.948165:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482921.948222:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482921.948310:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063959040 00000100:00100000:3.0:1788482921.948453:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063958912 00000100:00100000:3.0:1788482921.948465:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063958912 00000100:00100000:3.0:1788482921.948547:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:3.0:1788482921.948561:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063958912:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482921.948662:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063958912:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 104us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482921.948671:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00080000:3.0:1788482921.948705:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482921.948877:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063959296 00000100:00100000:3.0:1788482921.948882:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063959296 00000100:00100000:3.0:1788482921.948922:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063959168 00000100:00100000:3.0:1788482921.948925:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063959168 00000100:00100000:3.0:1788482921.948943:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:3.0:1788482921.948949:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959296:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482921.948986:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959296:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 36us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482921.949002:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:3.0:1788482921.949030:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:3.0:1788482921.949037:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959168:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482921.949064:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959168:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482921.949071:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00080000:3.0:1788482921.949144:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482921.949147:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788482921.949432:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063959040 00000100:00100000:2.0:1788482921.949478:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:2.0:1788482921.949487:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959040:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482921.949522:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959040:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 37us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482921.949530:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:1.0:1788482921.950097:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063958784 00000100:00100000:1.0:1788482921.950105:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063958784 00000100:00100000:1.0:1788482921.950147:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:1.0:1788482921.950155:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063958784:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482921.950215:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063958784:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 62us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482921.950222:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00080000:1.0:1788482921.950298:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788482922.354665:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788482923.325729:0:10305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788482923.382832:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482924.403153:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482924.468160:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072381568:0@lo:400:kworker.0 00000100:00100000:2.0:1788482924.468187:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072381824:0@lo:400:kworker.0 00000100:00100000:0.0:1788482924.468291:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072381696:0@lo:400:kworker.0 00000100:00100000:3.0:1788482924.470538:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072381952:0@lo:400:kworker.0 00000100:00100000:1.0:1788482924.480437:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482924.480555:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072382080:0@lo:400:kworker.0 00000100:00100000:1.0:1788482924.480603:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482924.480663:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072382080 00000100:00100000:1.0:1788482924.480671:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072382080 00000100:00100000:1.0:1788482924.480734:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788482924.480744:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072382080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482924.480802:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072382080:12345-0@lo:400:kworker.0 Request processed in 59us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482924.480809:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788482924.480832:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482924.480868:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072382080:0@lo:400:kworker.0 00000100:00100000:1.0:1788482924.480998:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072381568 00000100:00100000:1.0:1788482924.481002:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072381568 00000100:00100000:1.0:1788482924.481053:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788482924.481060:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072381568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482924.481118:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072381568:12345-0@lo:400:kworker.0 Request processed in 59us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482924.481124:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788482924.481160:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072381568:0@lo:400:kworker.0 00000100:00100000:2.0:1788482924.488549:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482924.488785:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072381824 00000100:00100000:2.0:1788482924.488797:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072381824 00000100:00100000:2.0:1788482924.488855:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788482924.488864:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072381824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482924.488935:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072381824:12345-0@lo:400:kworker.0 Request processed in 73us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482924.488942:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788482924.488966:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482924.489000:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072381824:0@lo:400:kworker.0 00000100:00100000:0.0:1788482924.498227:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482924.498313:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072382208:0@lo:400:kworker.0 00000100:00100000:0.0:1788482924.498361:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482924.498841:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482924.499003:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072382208 00000100:00100000:2.0:1788482924.499013:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072382208 00000100:00100000:2.0:1788482924.499099:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072381952 00000100:00100000:2.0:1788482924.499104:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072381952 00000100:00100000:2.0:1788482924.499122:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788482924.499146:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072382208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482924.499204:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072382208:12345-0@lo:400:kworker.0 Request processed in 59us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482924.499211:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788482924.499228:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788482924.499234:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93b171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072381952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482924.499288:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93b171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072381952:12345-0@lo:400:kworker.0 Request processed in 54us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482924.499294:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788482924.500222:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072381696 00000100:00100000:1.0:1788482924.500232:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072381696 00000100:00100000:1.0:1788482924.500313:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788482924.500323:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072381696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482924.500381:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072381696:12345-0@lo:400:kworker.0 Request processed in 60us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482924.500388:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788482924.502741:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072381696:0@lo:400:kworker.0 00010000:00080000:0.0:1788482924.502763:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f257100 x1875360072382208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482924.502775:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072382208:0@lo:400:kworker.0 00000100:00080000:3.0:1788482924.503870:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482924.503878:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788482924.503914:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb920894700 x1875360072381952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482924.503928:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072381952:0@lo:400:kworker.0 00000100:00100000:1.0:1788482924.978585:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482924.978622:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072382336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482924.978741:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482924.978897:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072382336 00000100:00100000:1.0:1788482924.978909:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072382336 00000100:00100000:1.0:1788482924.978994:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788482924.979011:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072382336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482924.979082:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482924.979158:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072382336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482924.979170:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788482924.979482:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b9880 x1875360072382336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482924.979515:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072382336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482925.427535:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482926.005238:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788482926.005288:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072382464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482926.005363:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482926.005443:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072382464 00000100:00100000:2.0:1788482926.005451:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072382464 00000100:00100000:2.0:1788482926.005676:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788482926.005687:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072382464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482926.005735:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482926.005794:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072382464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482926.005801:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788482926.008645:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788482926.009118:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f256a00 x1875360072382464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482926.009152:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072382464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788482926.450899:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482927.070907:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482927.070949:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482927.070972:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482927.071007:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482927.071029:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482927.072174:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063959552 00000100:00100000:2.0:1788482927.072188:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063959552 00000100:00100000:2.0:1788482927.072277:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063959680 00000100:00100000:2.0:1788482927.072286:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063959680 00000100:00100000:2.0:1788482927.072313:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:2.0:1788482927.072323:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063959552:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:3.0:1788482927.072579:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482927.072685:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063959552:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 73us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482927.072693:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:2.0:1788482927.072711:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:2.0:1788482927.072719:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959680:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482927.072750:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959680:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 33us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482927.072756:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:2.0:1788482927.072775:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063959808 00000100:00100000:2.0:1788482927.072779:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063959808 00000100:00100000:2.0:1788482927.072821:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063959936 00000100:00100000:2.0:1788482927.072824:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063959936 00000100:00100000:2.0:1788482927.072840:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1788482927.072845:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959808:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482927.072872:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959808:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482927.072878:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1788482927.072889:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1788482927.072895:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959936:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482927.072917:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063959936:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 22us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482927.072922:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00080000:3.0:1788482927.084852:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482927.084863:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482927.088352:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063959424 00000100:00100000:0.0:1788482927.088370:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063959424 00000100:00100000:0.0:1788482927.088434:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 223 00000100:00100000:0.0:1788482927.088456:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063959424:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482927.088541:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063959424:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 97us (17566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482927.088548:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 223 00010000:00010000:3.0:1788482927.485272:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482928.499501:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482929.525631:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482929.587126:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072382848:0@lo:400:kworker.0 00000100:00100000:3.0:1788482929.587201:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482929.587304:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788482929.587311:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072382720:0@lo:400:kworker.0 00000100:00100000:3.0:1788482929.587334:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482929.587350:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072383232:0@lo:400:kworker.0 00000100:00100000:3.0:1788482929.587372:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482929.587690:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072382976:0@lo:400:kworker.0 00000100:00100000:1.0:1788482929.587724:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482929.587743:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788482929.587749:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072382592:0@lo:400:kworker.0 00000100:00100000:1.0:1788482929.587780:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482929.587804:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072383104:0@lo:400:kworker.0 00000100:00100000:1.0:1788482929.587827:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482929.587858:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072382592 00000100:00100000:1.0:1788482929.587865:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072382592 00000100:00100000:1.0:1788482929.587910:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788482929.587919:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072382592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482929.587982:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072382592:12345-0@lo:400:kworker.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482929.587989:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788482929.588032:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072382592:0@lo:400:kworker.0 00000100:00100000:2.0:1788482929.588134:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072382848 00000100:00100000:2.0:1788482929.588139:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072382848 00000100:00100000:2.0:1788482929.588184:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072382720 00000100:00100000:2.0:1788482929.588187:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072382720 00000100:00100000:2.0:1788482929.588197:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072383104 00000100:00100000:2.0:1788482929.588199:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072383104 00000100:00100000:2.0:1788482929.588212:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788482929.588218:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072382848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482929.588293:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072382848:12345-0@lo:400:kworker.0 Request processed in 75us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482929.588300:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788482929.588313:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788482929.588319:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072382720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482929.588348:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072382720:12345-0@lo:400:kworker.0 Request processed in 29us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482929.588354:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788482929.588366:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788482929.588372:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072383104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482929.588419:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072383104:12345-0@lo:400:kworker.0 Request processed in 47us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482929.588425:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788482929.588446:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072383232 00000100:00100000:2.0:1788482929.588449:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072383232 00000100:00100000:2.0:1788482929.588471:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072382976 00000100:00100000:2.0:1788482929.588474:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072382976 00000100:00100000:2.0:1788482929.588486:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788482929.588491:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072383232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482929.588522:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072383232:12345-0@lo:400:kworker.0 Request processed in 30us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482929.588546:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788482929.588558:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788482929.588564:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072382976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482929.588591:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072382976:12345-0@lo:400:kworker.0 Request processed in 28us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482929.588596:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788482929.588635:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072383104:0@lo:400:kworker.0 00010000:00080000:2.0:1788482929.588647:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93704c000 x1875360072382976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482929.588657:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072382976:0@lo:400:kworker.0 00000100:00100000:2.0:1788482929.588683:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072382720:0@lo:400:kworker.0 00010000:00080000:2.0:1788482929.588692:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937264a80 x1875360072383232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482929.588700:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072383232:0@lo:400:kworker.0 00000100:00100000:2.0:1788482929.588710:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072382848:0@lo:400:kworker.0 00000100:00080000:1.0:1788482929.588991:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482929.588995:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482929.588998:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482930.098626:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482930.098651:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072383360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482930.098729:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482930.098841:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072383360 00000100:00100000:1.0:1788482930.098850:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072383360 00000100:00100000:1.0:1788482930.098909:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788482930.098920:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072383360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482930.098966:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482930.099016:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072383360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482930.099036:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788482930.099080:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b9500 x1875360072383360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482930.099097:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072383360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788482930.546708:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482931.127861:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072383488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482931.127946:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482931.128598:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072383488 00000100:00100000:0.0:1788482931.128610:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072383488 00000100:00100000:0.0:1788482931.128690:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788482931.128701:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072383488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482931.128738:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482931.128802:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072383488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482931.128809:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788482931.128859:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b9500 x1875360072383488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482931.128882:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072383488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788482931.128954:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788482931.570586:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482932.202049:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482932.202100:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482932.202111:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063960192 00000100:00100000:2.0:1788482932.202123:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063960192 00000100:00100000:3.0:1788482932.202161:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482932.202195:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063960320 00000100:00100000:2.0:1788482932.202200:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063960320 00000100:00100000:3.0:1788482932.202217:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482932.202226:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:2.0:1788482932.202240:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063960192:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482932.202281:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482932.202377:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063960192:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 140us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482932.202385:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:2.0:1788482932.202403:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:2.0:1788482932.202409:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063960320:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482932.202432:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063960320:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482932.202439:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00080000:2.0:1788482932.202456:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482932.202478:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063960576 00000100:00100000:2.0:1788482932.202483:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063960576 00000100:00100000:2.0:1788482932.202513:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063960448 00000100:00100000:2.0:1788482932.202515:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063960448 00000100:00100000:2.0:1788482932.202529:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:2.0:1788482932.202536:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063960576:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482932.202561:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063960576:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482932.202567:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:2.0:1788482932.202583:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:2.0:1788482932.202590:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2351:x1875360063960448:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482932.202614:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2351:x1875360063960448:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482932.202621:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00080000:2.0:1788482932.202643:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788482932.202645:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788482932.202893:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063960064 00000100:00100000:1.0:1788482932.202898:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063960064 00000100:00100000:1.0:1788482932.202947:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:1.0:1788482932.202964:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360063960064:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482932.203003:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360063960064:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 49us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482932.203008:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 225 00010000:00010000:1.0:1788482932.596031:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482933.619828:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482934.648191:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482934.722931:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072383744:0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.723035:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482934.723118:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072384256:0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.723149:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482934.723191:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482934.723198:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072383872:0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.723222:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482934.723296:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072383744 00000100:00100000:2.0:1788482934.723306:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072383744 00000100:00100000:2.0:1788482934.723375:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072383872 00000100:00100000:2.0:1788482934.723379:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072383872 00000100:00100000:2.0:1788482934.723413:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788482934.723423:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072383744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.723490:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072383744:12345-0@lo:400:kworker.0 Request processed in 67us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482934.723497:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788482934.723522:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788482934.723529:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072383872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.723556:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072383872:12345-0@lo:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482934.723563:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788482934.723584:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072384256 00000100:00100000:2.0:1788482934.723588:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072384256 00000100:00100000:2.0:1788482934.723623:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788482934.723629:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072384256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.723662:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072384256:12345-0@lo:400:kworker.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482934.723689:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788482934.724859:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788482934.724936:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482934.724978:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788482934.724987:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072383616:0@lo:400:kworker.0 00000100:00100000:0.0:1788482934.725020:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482934.725479:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072384000 00000100:00100000:2.0:1788482934.725489:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072384000 00000100:00100000:2.0:1788482934.725530:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788482934.725540:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072384000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.725593:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072384000:12345-0@lo:400:kworker.0 Request processed in 55us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482934.725600:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788482934.725633:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788482934.725637:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788482934.725640:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482934.725707:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072383872:0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.725726:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072383744:0@lo:400:kworker.0 00010000:00080000:2.0:1788482934.725745:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f256d80 x1875360072384256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482934.725756:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072384256:0@lo:400:kworker.0 00000100:00100000:0.0:1788482934.726177:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072384128:0@lo:400:kworker.0 00000100:00100000:0.0:1788482934.726230:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788482934.726291:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f255880 x1875360072384000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482934.726301:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788482934.726438:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072383616 00000100:00100000:0.0:1788482934.726445:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072383616 00000100:00100000:0.0:1788482934.726484:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788482934.726493:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072383616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482934.726540:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072383616:12345-0@lo:400:kworker.0 Request processed in 48us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482934.726547:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788482934.726592:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072383616:0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.727039:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072384128 00000100:00100000:2.0:1788482934.727045:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072384128 00000100:00100000:2.0:1788482934.727104:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788482934.727113:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072384128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482934.727169:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072384128:12345-0@lo:400:kworker.0 Request processed in 58us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482934.727177:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788482934.727213:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072384128:0@lo:400:kworker.0 00000100:00080000:0.0:1788482934.727388:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482935.225404:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482935.225451:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072384384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482935.225556:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482935.229794:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072384384 00000100:00100000:0.0:1788482935.229816:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072384384 00000100:00100000:0.0:1788482935.229908:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788482935.229923:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072384384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788482935.229977:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482935.230459:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072384384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 538us (4901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482935.230470:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788482935.230537:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b8700 x1875360072384384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482935.230660:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072384384:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788482935.666433:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482936.247443:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072384512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788482936.247552:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482936.248347:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072384512 00000100:00100000:1.0:1788482936.248363:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072384512 00000100:00080000:2.0:1788482936.248456:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482936.248458:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788482936.248472:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072384512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482936.248917:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482936.249046:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072384512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 576us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482936.249054:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788482936.249466:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1bb800 x1875360072384512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482936.249494:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072384512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482936.691346:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482937.318612:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482937.318687:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482937.318734:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482937.318882:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063960704 00000100:00100000:1.0:1788482937.318898:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063960704 00000100:00100000:1.0:1788482937.318972:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:1.0:1788482937.318985:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063960704:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482937.320536:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063960704:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 1538us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482937.320554:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:3.0:1788482937.320962:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063960960 00000100:00100000:3.0:1788482937.320974:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063960960 00000100:00100000:3.0:1788482937.321047:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:3.0:1788482937.321060:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063960960:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482937.321123:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063960960:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 66us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482937.321130:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00080000:3.0:1788482937.321161:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482937.321310:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063961088 00000100:00100000:0.0:1788482937.321316:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063961088 00000100:00100000:0.0:1788482937.321363:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1788482937.321499:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2350:x1875360063961088:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:0.0:1788482937.321527:0:6660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78bf4 00000100:00080000:0.0:1788482937.321540:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb936e2e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788482937.321587:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788482937.322023:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5778eeb0-8512-44ab-a78a-f60f28116302+2:2350:x1875360063961088:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 526us (3426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.322031:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00080000:3.0:1788482937.322690:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788482937.322706:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482937.324936:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482937.325002:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482937.325056:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063961216 00000100:00100000:1.0:1788482937.325545:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063960832 00000100:00100000:1.0:1788482937.325558:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063960832 00000100:00100000:1.0:1788482937.325643:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:1.0:1788482937.325655:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063960832:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482937.325844:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063961216 00000100:00100000:0.0:1788482937.325884:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1788482937.325892:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5778eeb0-8512-44ab-a78a-f60f28116302+5:2350:x1875360063961216:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:0.0:1788482937.325920:0:6663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78bfb 00000100:00080000:0.0:1788482937.325931:0:6663:0:(import.c:65:import_set_state_nolock()) ffff9eb936e2a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788482937.325978:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1788482937.326157:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482937.326163:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482937.327156:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063960832:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 97us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482937.327177:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00010000:00010000:1.0:1788482937.327214:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482937.328983:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5778eeb0-8512-44ab-a78a-f60f28116302+2:2350:x1875360063961216:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 3074us (3962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482937.329001:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:3.0:1788482937.714508:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788482938.390323:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5778eeb0-8512-44ab-a78a-f60f28116302 00000020:00000080:2.0:1788482938.390336:0:6686:0:(genops.c:885:class_export_put()) final put ffff9eb936e2a800/5778eeb0-8512-44ab-a78a-f60f28116302 00000020:00000080:0.0:1788482938.390904:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb936e2a800/5778eeb0-8512-44ab-a78a-f60f28116302 for lustre-OST0000 00000020:00000080:0.0:1788482938.391009:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb936e2e800 for lustre-OST0000 00010000:00010000:0.0:1788482938.738549:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482939.762734:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482939.826637:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072384768:0@lo:400:kworker.0 00000100:00100000:0.0:1788482939.826746:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482939.826883:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072384640:0@lo:400:kworker.0 00000100:00100000:1.0:1788482939.826967:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072385024:0@lo:400:kworker.0 00000100:00100000:0.0:1788482939.830024:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072385280:0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.832472:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482939.832578:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072385152:0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.832636:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482939.832961:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072384640 00000100:00100000:2.0:1788482939.832973:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072384640 00000100:00100000:2.0:1788482939.833038:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788482939.833050:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072384640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.833119:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072384640:12345-0@lo:400:kworker.0 Request processed in 71us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482939.833127:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788482939.833167:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072384768 00000100:00100000:2.0:1788482939.833172:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072384768 00000100:00100000:2.0:1788482939.833200:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072385152 00000100:00100000:2.0:1788482939.833203:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072385152 00000100:00100000:2.0:1788482939.833236:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788482939.833242:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072384768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.833306:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072384768:12345-0@lo:400:kworker.0 Request processed in 64us (6560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482939.833314:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788482939.833326:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788482939.833332:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072385152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.833360:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072385152:12345-0@lo:400:kworker.0 Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482939.833388:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788482939.833411:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482939.833458:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072384640:0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.833474:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072385152:0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.833543:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072384896:0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.833574:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482939.833604:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072384896 00000100:00100000:2.0:1788482939.833608:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072384896 00000100:00100000:2.0:1788482939.833745:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788482939.833752:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072384896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.833802:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072384896:12345-0@lo:400:kworker.0 Request processed in 50us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482939.833808:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788482939.833823:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482939.833840:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072384896:0@lo:400:kworker.0 00000100:00100000:1.0:1788482939.838331:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482939.838525:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072385024 00000100:00100000:2.0:1788482939.838540:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072385024 00000100:00100000:2.0:1788482939.838629:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788482939.838644:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072385024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482939.838737:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072385024:12345-0@lo:400:kworker.0 Request processed in 98us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482939.838745:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788482939.838828:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788482939.838868:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93fe53b80 x1875360072385024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482939.838886:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072385024:0@lo:400:kworker.0 00000100:00100000:0.0:1788482939.839584:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482939.839698:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072384768:0@lo:400:kworker.0 00000100:00100000:1.0:1788482939.839764:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072385280 00000100:00100000:1.0:1788482939.839784:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072385280 00000100:00100000:1.0:1788482939.840009:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788482939.840023:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072385280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482939.840112:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072385280:12345-0@lo:400:kworker.0 Request processed in 93us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482939.840120:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788482939.840275:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788482939.841164:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93fe50a80 x1875360072385280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482939.841182:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072385280:0@lo:400:kworker.0 00000100:00100000:0.0:1788482940.339173:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482940.339206:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072385408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482940.339340:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482940.339490:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072385408 00000100:00100000:3.0:1788482940.339501:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072385408 00000100:00100000:3.0:1788482940.339570:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788482940.339583:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072385408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788482940.339888:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482940.339957:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072385408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 376us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482940.339965:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788482940.339985:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f1b8700 x1875360072385408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482940.340008:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072385408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482940.787569:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482941.367719:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072385536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482941.367829:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482941.367973:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072385536 00000100:00100000:0.0:1788482941.367986:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072385536 00000100:00100000:0.0:1788482941.368077:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788482941.368091:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072385536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482941.368152:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788482941.368240:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482941.371680:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072385536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3572us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482941.371702:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788482941.372040:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e13b80 x1875360072385536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482941.372083:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072385536:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482941.811679:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482942.428409:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482942.428745:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482942.428897:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482942.429469:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063961600 00000100:00100000:2.0:1788482942.429505:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063961600 00000100:00100000:0.0:1788482942.429927:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063961344 00000100:00100000:0.0:1788482942.429936:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063961344 00000100:00080000:1.0:1788482942.429962:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482942.430003:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:0.0:1788482942.430017:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2353:x1875360063961344:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482942.430283:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063961472 00000100:00100000:2.0:1788482942.430306:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063961472 00000100:00100000:2.0:1788482942.430349:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:0.0:1788482942.430354:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2353:x1875360063961344:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 340us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482942.430357:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2353:x1875360063961600:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482942.430408:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2353:x1875360063961600:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 52us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482942.430416:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:2.0:1788482942.430439:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:2.0:1788482942.430446:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063961472:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482942.430472:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063961472:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482942.430491:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00080000:1.0:1788482942.431668:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482942.431912:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 229 00000001:00100000:0.0:1788482942.436055:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5778eeb0-8512-44ab-a78a-f60f28116302 00000020:00000080:0.0:1788482942.436068:0:7620:0:(genops.c:885:class_export_put()) final put ffff9eb936e28800/5778eeb0-8512-44ab-a78a-f60f28116302 00000020:00000080:1.0:1788482942.436457:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb936e28800/5778eeb0-8512-44ab-a78a-f60f28116302 for lustre-OST0001 00000020:00000080:1.0:1788482942.436533:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb936e2a000 for lustre-OST0001 00010000:00010000:1.0:1788482942.834463:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788482943.787151:0:11006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788482943.859406:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482944.883084:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482944.949529:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072386048:0@lo:400:kworker.0 00000100:00100000:1.0:1788482944.949599:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482944.952158:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788482944.952188:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072385664:0@lo:400:kworker.0 00000100:00100000:1.0:1788482944.952294:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482944.952336:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072386176:0@lo:400:kworker.0 00000100:00100000:1.0:1788482944.952366:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482944.952427:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072386048 00000100:00100000:1.0:1788482944.952436:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072386048 00000100:00100000:1.0:1788482944.952513:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788482944.952524:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072386048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482944.952594:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072386048:12345-0@lo:400:kworker.0 Request processed in 71us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482944.952811:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072385920:0@lo:400:kworker.0 00000100:00100000:2.0:1788482944.952847:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482944.952872:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788482944.952879:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072385792:0@lo:400:kworker.0 00000100:00100000:2.0:1788482944.952905:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482944.952926:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072386304:0@lo:400:kworker.0 00000100:00100000:2.0:1788482944.952948:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482944.952975:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072386176 00000100:00100000:2.0:1788482944.952978:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072386176 00000100:00100000:2.0:1788482944.953019:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072385920 00000100:00100000:2.0:1788482944.953023:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072385920 00000100:00100000:2.0:1788482944.953035:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072385792 00000100:00100000:2.0:1788482944.953038:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072385792 00000100:00100000:2.0:1788482944.953066:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788482944.953073:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072386176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482944.953107:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072386176:12345-0@lo:400:kworker.0 Request processed in 35us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482944.953128:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788482944.953136:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788482944.953145:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072385920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482944.953149:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788482944.953153:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072385792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482944.953182:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072385792:12345-0@lo:400:kworker.0 Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482944.953187:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788482944.953193:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788482944.953204:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072386304 00000100:00100000:1.0:1788482944.953208:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072386304 00000100:00100000:1.0:1788482944.953229:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788482944.953245:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072386304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482944.955814:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072386304:12345-0@lo:400:kworker.0 Request processed in 2560us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482944.955829:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788482944.955844:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072385792:0@lo:400:kworker.0 00010000:00080000:2.0:1788482944.955870:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb9406f7480 x1875360072386304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482944.955880:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072386304:0@lo:400:kworker.0 00000100:00100000:1.0:1788482944.955883:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072385664 00000100:00100000:1.0:1788482944.955889:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072385664 00000100:00100000:1.0:1788482944.955948:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788482944.955956:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072385664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482944.956483:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072385664:12345-0@lo:400:kworker.0 Request processed in 525us (4187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482944.956490:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:1.0:1788482944.956519:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482944.956524:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788482944.956527:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482944.956548:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072385664:0@lo:400:kworker.0 00000100:00100000:1.0:1788482944.956563:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072386176:0@lo:400:kworker.0 00010000:00080000:1.0:1788482944.956575:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93704d880 x1875360072386048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482944.956585:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072386048:0@lo:400:kworker.0 00000100:00100000:0.0:1788482944.958435:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072385920:12345-0@lo:400:kworker.0 Request processed in 5285us (5580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482944.958451:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788482944.972348:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072385920:0@lo:400:kworker.0 00000100:00100000:3.0:1788482945.466789:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482945.466812:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072386432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482945.466879:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482945.466963:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072386432 00000100:00100000:3.0:1788482945.466971:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072386432 00000100:00100000:3.0:1788482945.467017:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788482945.467039:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072386432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788482945.467074:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482945.467120:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072386432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482945.467127:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788482945.467185:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb903110000 x1875360072386432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482945.467203:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072386432:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788482945.915496:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482946.484012:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072386560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482946.484088:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482946.484537:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072386560 00000100:00100000:0.0:1788482946.484548:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072386560 00000100:00100000:0.0:1788482946.484624:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788482946.484636:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072386560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788482946.484682:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482946.484744:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072386560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482946.484751:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788482946.484823:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788482946.484904:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb936e10e00 x1875360072386560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482946.484926:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072386560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482946.930446:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788482947.238046:0:11153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0e10eaa0 20000000:00000080:1.0:1788482947.238064:0:11153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eb937e35000 uarg=0000000000000000 20000000:01000000:1.0:1788482947.238102:0:11153:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788482947.238108:0:11153:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788482947.238113:0:11153:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788482947.239183:0:11154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788482947.239668:0:11153:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788482947.246054:0:11153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788482947.246094:0:11153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246114:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78ba7 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246122:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78bb5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246128:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78bc3 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246138:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246144:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246150:0:11153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246198:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246228:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 12 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.246245:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072386688:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482947.246666:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246675:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 12 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.246684:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072386816:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482947.246716:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78bc3 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246725:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78bc3 expref: 18 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.246733:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072386944:0@lo:104: 00000100:00100000:1.0:1788482947.246775:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482947.246821:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78bb5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246830:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78bb5 expref: 18 pid: 5800 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.246838:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072387072:0@lo:104: 00000100:00100000:1.0:1788482947.246858:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482947.246902:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78ba7 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.246909:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78ba7 expref: 18 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.246917:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072387200:0@lo:104: 00000100:00100000:1.0:1788482947.246953:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482947.246988:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072386944 00000100:00100000:1.0:1788482947.246996:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072386944 00000100:00100000:1.0:1788482947.247035:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072387072 00000100:00100000:1.0:1788482947.247038:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072387072 00000100:00100000:1.0:1788482947.247047:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072387200 00000100:00100000:1.0:1788482947.247050:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072387200 00000100:00100000:1.0:1788482947.247062:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788482947.247071:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:11153:x1875360072386944:12345-0@lo:104: 00010000:00010000:1.0:1788482947.247088:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.247139:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788482947.247145:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:11153:x1875360072386944:12345-0@lo:104: Request processed in 74us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482947.247152:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788482947.247172:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788482947.247179:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:11153:x1875360072387072:12345-0@lo:104: 00010000:00010000:1.0:1788482947.247186:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.247218:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788482947.247223:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:11153:x1875360072387072:12345-0@lo:104: Request processed in 45us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482947.247235:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788482947.247573:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788482947.247583:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:11153:x1875360072387200:12345-0@lo:104: 00010000:00010000:1.0:1788482947.247591:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.247624:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788482947.247629:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:11153:x1875360072387200:12345-0@lo:104: Request processed in 50us (677us total) trans 0 rc 0/0 00010000:00010000:2.0:1788482947.248210:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788482947.248218:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248226:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493000 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788482947.248241:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248278:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482947.248285:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482947.248291:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788482947.248330:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248336:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482947.248359:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248366:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb901493000/0x42820277aad78bc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248378:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788482947.248382:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248388:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788482947.248391:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248397:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482947.248413:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482947.248418:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788482947.248431:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248436:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482947.248453:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248459:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f626400/0x42820277aad78bb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bbc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248467:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482947.248470:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248475:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626000 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788482947.248477:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248483:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788482947.248489:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788482947.248494:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788482947.248515:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248521:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788482947.248527:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248533:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78ba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78bae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.248546:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482947.248547:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482947.248549:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482947.248564:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072387328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788482947.248609:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482947.248677:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072387456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788482947.248703:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482947.248724:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482947.248729:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072387584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788482947.248749:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482947.248778:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072387328 00000100:00100000:2.0:1788482947.248786:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072387328 00010000:00010000:2.0:1788482947.248810:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78bc3 expref: 19 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482947.248832:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072387456 00000100:00100000:2.0:1788482947.248835:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072387456 00010000:00010000:2.0:1788482947.248845:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78bb5 expref: 20 pid: 5800 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482947.248866:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072387584 00000100:00100000:2.0:1788482947.249015:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072387584 00010000:00010000:2.0:1788482947.249029:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78ba7 expref: 21 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482947.249044:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482947.249051:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+21:3280:x1875360072387328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788482947.249062:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482947.249068:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78bc3 expref: 21 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.249076:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78bc3 expref: 21 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.249092:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482947.249125:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+21:3280:x1875360072387328:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482947.249132:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482947.249176:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482947.249182:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+20:3277:x1875360072387456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788482947.249189:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482947.249194:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78bb5 expref: 20 pid: 5800 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.249201:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78bb5 expref: 20 pid: 5800 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.249211:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482947.249244:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+20:3277:x1875360072387456:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482947.249329:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788482947.249342:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482947.249349:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3277:x1875360072387584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788482947.249356:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482947.249360:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78ba7 expref: 19 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.249368:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78ba7 expref: 19 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482947.249377:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482947.249400:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3277:x1875360072387584:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482947.249405:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482947.249450:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072387328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788482947.249475:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072387584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788482947.249481:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072387456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482947.249667:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482947.249680:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482947.249968:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788482947.250018:0:11153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a00c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788482947.250039:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f780c00/0x42820277aad78bca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78bc3 expref: 18 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.250049:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072386944:0@lo:104: 00010000:00010000:1.0:1788482947.250059:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f781600/0x42820277aad78bbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78bb5 expref: 17 pid: 5800 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.250067:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072387072:0@lo:104: 00010000:00010000:1.0:1788482947.250076:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f780800/0x42820277aad78bae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78ba7 expref: 16 pid: 5802 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.250082:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072387200:0@lo:104: 00000100:00100000:3.0:1788482947.253966:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072386688:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482947.253980:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1875360072386816:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788482947.254017:0:11153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482947.259328:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482947.259421:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482947.259626:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063961728 00000100:00100000:1.0:1788482947.259638:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063961728 00010000:00010000:1.0:1788482947.259686:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 13 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.259744:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063961856 00000100:00100000:1.0:1788482947.259748:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063961856 00010000:00010000:1.0:1788482947.259762:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 14 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.259786:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1788482947.259797:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+14:2351:x1875360063961728:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788482947.259814:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482947.259820:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 14 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.259833:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 14 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.259850:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901493400/0x42820277aad78be6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707795f expref: 14 pid: 5802 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.259865:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482947.259919:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360063961728:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 124us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482947.259927:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1788482947.259943:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:1.0:1788482947.259949:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:2351:x1875360063961856:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788482947.259957:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482947.259961:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 12 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.259980:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 12 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.259988:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901493600/0x42820277aad78bd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077927 expref: 12 pid: 5800 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.259998:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260005:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260019:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260026:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260032:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260038:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260045:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788482947.260049:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260056:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260079:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482947.260090:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482947.260109:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:2351:x1875360063961856:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 160us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482947.260116:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00010000:00010000:3.0:1788482947.260613:0:11153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482947.260623:0:11153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482947.260630:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f627600/0x42820277aad78c02 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482947.548966:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482947.549020:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482947.549058:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482947.549202:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063962240 00000100:00100000:3.0:1788482947.549224:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063962240 00000100:00100000:3.0:1788482947.549313:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063962112 00000100:00100000:3.0:1788482947.549316:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063962112 00000100:00100000:3.0:1788482947.549340:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:3.0:1788482947.549350:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063962240:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482947.549454:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063962240:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 104us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482947.549462:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:3.0:1788482947.549485:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:3.0:1788482947.549491:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063962112:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482947.549515:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063962112:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482947.549522:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00080000:1.0:1788482947.550169:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482947.550245:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063961984 00000100:00100000:2.0:1788482947.550284:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063961984 00000100:00100000:2.0:1788482947.550325:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 231 00000100:00100000:2.0:1788482947.550333:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:2354:x1875360063961984:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482947.550540:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:2354:x1875360063961984:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 207us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482947.550549:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 231 00010000:00010000:3.0:1788482947.955405:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482948.574728:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482948.575032:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063962368 00000100:00100000:3.0:1788482948.575047:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063962368 00000100:00100000:3.0:1788482948.575127:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 232 00000100:00100000:3.0:1788482948.575140:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:5595:x1875360063962368:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482948.575165:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482948.575200:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077989 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482948.575240:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482948.575291:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482948.575304:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493a00, rc 0) 00000100:00100000:3.0:1788482948.575373:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063962368:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 236us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482948.575403:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 232 00000100:00100000:1.0:1788482948.584508:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482948.584657:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063962496 00000100:00100000:3.0:1788482948.584682:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063962496 00000100:00100000:3.0:1788482948.584759:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 233 00000100:00100000:3.0:1788482948.584771:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063962496:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482948.585437:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063962496:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 662us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482948.585453:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 233 00000100:00100000:0.0:1788482948.592382:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482948.592670:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063962624 00000100:00100000:2.0:1788482948.592685:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063962624 00000100:00100000:2.0:1788482948.592769:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 234 00000100:00100000:2.0:1788482948.592782:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063962624:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482948.593143:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063962624:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 361us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482948.593161:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 234 00000100:00100000:0.0:1788482948.600645:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482948.601371:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063962752 00000100:00100000:3.0:1788482948.601388:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063962752 00000100:00100000:3.0:1788482948.601482:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 235 00000100:00100000:3.0:1788482948.601497:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063962752:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482948.601521:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482948.601552:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077990 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482948.601601:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482948.601613:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482948.601634:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492800, rc 0) 00000100:00100000:3.0:1788482948.601735:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063962752:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 241us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482948.601745:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 235 00000100:00100000:3.0:1788482948.605168:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482948.605388:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063962880 00000100:00100000:1.0:1788482948.605404:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063962880 00000100:00100000:1.0:1788482948.605477:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:1.0:1788482948.605490:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063962880:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482948.605977:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063962880:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 487us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482948.605988:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:3.0:1788482948.622224:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482948.624136:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063963008 00000100:00100000:0.0:1788482948.624158:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063963008 00000100:00100000:0.0:1788482948.624310:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 237 00000100:00100000:0.0:1788482948.624324:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063963008:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482948.625300:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063963008:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 971us (3085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482948.625313:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 237 00010000:00010000:0.0:1788482948.982143:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788482949.236211:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788482949.236220:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb93f7bc000 from 7 10000000:01000000:3.0:1788482949.236225:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788482949.236307:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482949.236319:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482949.236331:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482949.236357:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072387712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788482949.236428:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482949.236484:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb92e957900 going to sleep for 11 seconds 00000100:00100000:1.0:1788482949.236698:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072387712 00000100:00100000:1.0:1788482949.236706:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072387712 00000100:00100000:1.0:1788482949.236750:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788482949.236772:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072387712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482949.236785:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482949.236799:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78c17 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.236851:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78c17 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.236861:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78c17 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.236869:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626c00, rc 0) 00000100:00100000:1.0:1788482949.236917:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072387712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482949.236924:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788482949.237024:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072387712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482949.237039:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482949.237048:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482949.237101:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072387840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482949.237130:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482949.237153:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f7733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482949.237166:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072387840 00000100:00100000:0.0:1788482949.237170:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072387840 00000100:00100000:0.0:1788482949.237192:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788482949.237198:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072387840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482949.237492:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072387840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482949.237498:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788482949.237545:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072387840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482949.237571:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072387968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482949.237607:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482949.237634:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f7779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482949.237648:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072387968 00000100:00100000:0.0:1788482949.237651:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072387968 00000100:00100000:0.0:1788482949.237670:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788482949.237674:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072387968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482949.237817:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072387968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482949.237824:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788482949.237860:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072387968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788482949.240005:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788482949.240126:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788482949.240151:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788482949.240165:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.240181:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482949.240194:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788482949.240198:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb906309000 from 7 10000000:01000000:1.0:1788482949.240202:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788482949.240281:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.240290:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.240301:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482949.240347:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482949.240415:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482949.240462:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482949.244138:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072388096 00000100:00100000:0.0:1788482949.244156:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072388096 00000100:00100000:0.0:1788482949.244227:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788482949.244240:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072388096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482949.244275:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482949.244295:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78c25 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482949.244324:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78c25 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482949.244350:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78c25 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482949.244360:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368c00, rc 0) 00000100:00100000:0.0:1788482949.244448:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072388096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482949.244465:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788482949.244499:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482949.244520:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.244530:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482949.244625:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482949.244673:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482949.244717:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788482949.244730:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072388224 00000100:00100000:3.0:1788482949.244737:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072388224 00000100:00100000:3.0:1788482949.244772:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788482949.244780:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072388224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482949.245045:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072388224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482949.245052:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788482949.245101:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482949.245129:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482949.245166:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482949.245189:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482949.245374:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072388352 00000100:00100000:0.0:1788482949.245378:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072388352 00000100:00100000:0.0:1788482949.245411:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788482949.245418:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072388352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482949.245678:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072388352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482949.245685:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788482949.245746:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788482949.247287:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788482949.250143:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788482949.250187:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788482949.250202:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482949.250218:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482949.250232:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788482949.250235:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb9070c3000 from 7 10000000:01000000:0.0:1788482949.250237:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788482949.250299:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482949.250326:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482949.250340:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482949.250367:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788482949.250445:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482949.250510:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f777f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482949.250644:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072388480 00000100:00100000:1.0:1788482949.250654:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072388480 00000100:00100000:1.0:1788482949.250721:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788482949.250731:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072388480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482949.250748:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482949.250769:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78c33 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.250796:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78c33 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.250807:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78c33 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482949.250818:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626600, rc 0) 00000100:00100000:1.0:1788482949.250882:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072388480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482949.250888:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788482949.251522:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482949.251545:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482949.251554:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482949.251648:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482949.251682:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482949.251725:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f777f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482949.251843:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072388608 00000100:00100000:1.0:1788482949.251849:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072388608 00000100:00100000:1.0:1788482949.251888:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788482949.251897:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072388608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482949.252295:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072388608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482949.252304:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788482949.257894:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482949.257967:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482949.258042:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482949.258099:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910f5d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482949.258390:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072388736 00000100:00100000:1.0:1788482949.258397:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072388736 00000100:00100000:1.0:1788482949.258464:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788482949.258474:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072388736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482949.258711:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072388736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482949.258720:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788482949.262227:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f255880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072388736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788482949.270489:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788482949.270729:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788482949.270755:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788482949.270771:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482949.270784:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482950.002525:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482950.066505:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072388864:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.066591:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482950.066655:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072389376:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.066682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482950.066709:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788482950.066720:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072388992:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.066740:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482950.066756:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072389504:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.066776:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482950.066802:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072389120:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.066903:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482950.066927:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482950.066933:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072389248:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.066956:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482950.066991:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072389376 00000100:00100000:0.0:1788482950.067101:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072388864 00000100:00100000:0.0:1788482950.067108:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072388864 00000100:00100000:0.0:1788482950.067158:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788482950.067169:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072388864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482950.067227:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072388864:12345-0@lo:400:kworker.0 Request processed in 60us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482950.067243:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788482950.068811:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072389376 00000100:00100000:2.0:1788482950.068894:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072388992 00000100:00100000:2.0:1788482950.068899:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072388992 00000100:00100000:2.0:1788482950.068913:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072389120 00000100:00100000:2.0:1788482950.068915:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072389120 00000100:00100000:2.0:1788482950.068933:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788482950.068942:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072389376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069016:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072389376:12345-0@lo:400:kworker.0 Request processed in 75us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482950.069024:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788482950.069039:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788482950.069044:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072388992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069070:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072388992:12345-0@lo:400:kworker.0 Request processed in 26us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482950.069076:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788482950.069085:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788482950.069091:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072389120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069131:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072389120:12345-0@lo:400:kworker.0 Request processed in 40us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482950.069137:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788482950.069164:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072389504 00000100:00100000:2.0:1788482950.069168:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072389504 00000100:00100000:2.0:1788482950.069194:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072389248 00000100:00100000:2.0:1788482950.069197:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072389248 00000100:00100000:2.0:1788482950.069212:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788482950.069217:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072389504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069266:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072389504:12345-0@lo:400:kworker.0 Request processed in 30us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482950.069273:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788482950.069285:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788482950.069291:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072389248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069321:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072389248:12345-0@lo:400:kworker.0 Request processed in 31us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482950.069327:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788482950.069382:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92ec59500 x1875360072389248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482950.069397:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072389248:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069409:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072389120:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069447:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072388992:0@lo:400:kworker.0 00010000:00080000:2.0:1788482950.069459:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92ec58e00 x1875360072389504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482950.069469:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072389504:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069489:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072388864:0@lo:400:kworker.0 00000100:00100000:2.0:1788482950.069500:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072389376:0@lo:400:kworker.0 00000100:00080000:0.0:1788482950.072575:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788482950.072583:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788482950.072587:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482950.580535:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482950.580622:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482950.581396:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072389632 00000100:00100000:1.0:1788482950.581419:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072389632 00000100:00100000:1.0:1788482950.581484:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788482950.581497:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072389632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482950.581545:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482950.581617:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072389632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482950.581624:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788482950.581845:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937055c00 x1875360072389632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482950.582223:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072389632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482951.026494:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482951.602916:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482951.602945:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072389760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788482951.603042:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482951.603224:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072389760 00000100:00100000:3.0:1788482951.603238:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072389760 00000100:00100000:3.0:1788482951.603333:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788482951.603344:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072389760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788482951.603399:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482951.603459:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072389760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482951.603467:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788482951.603526:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb903111500 x1875360072389760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482951.603547:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072389760:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788482951.920979:0:11352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788482952.050464:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482952.676835:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482952.676893:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482952.679094:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482952.679163:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063963136 00000100:00100000:0.0:1788482952.679174:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063963136 00000100:00100000:0.0:1788482952.679241:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 248 00000100:00100000:0.0:1788482952.679296:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2353:x1875360063963136:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482952.679375:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2353:x1875360063963136:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 125us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482952.679383:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 248 00000100:00100000:2.0:1788482952.688937:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063963264 00000100:00100000:2.0:1788482952.688957:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063963264 00000100:00100000:2.0:1788482952.689640:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063963392 00000100:00100000:2.0:1788482952.689647:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063963392 00000100:00100000:3.0:1788482952.689717:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:3.0:1788482952.689730:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063963264:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482952.689832:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063963264:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 105us (12937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482952.689840:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00080000:1.0:1788482952.694115:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482952.694510:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:2.0:1788482952.694526:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063963392:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482952.694635:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063963392:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 114us (15549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482952.694643:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 101 00010000:00010000:0.0:1788482953.075060:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482954.100572:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482955.125929:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482955.188522:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072390272:0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.188579:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072389888:0@lo:400:kworker.0 00000100:00100000:0.0:1788482955.188706:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.193899:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482955.194035:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072390400:0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.194097:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482955.194162:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.194203:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482955.194278:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072389888 00000100:00100000:3.0:1788482955.194290:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072389888 00000100:00100000:3.0:1788482955.194360:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788482955.194371:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072389888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.194476:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072389888:12345-0@lo:400:kworker.0 Request processed in 106us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482955.194484:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788482955.194549:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072390400 00000100:00100000:3.0:1788482955.194554:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072390400 00000100:00100000:3.0:1788482955.194597:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072390144 00000100:00100000:3.0:1788482955.194599:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072390144 00000100:00100000:1.0:1788482955.195345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482955.195406:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072390272 00000100:00100000:1.0:1788482955.195412:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072390272 00000100:00100000:1.0:1788482955.195464:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788482955.195475:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072390272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482955.195543:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072390272:12345-0@lo:400:kworker.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482955.195551:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788482955.195605:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937057800 x1875360072390272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482955.196867:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072390272:0@lo:400:kworker.0 00000100:00100000:0.0:1788482955.197156:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788482955.197176:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072390400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482955.197288:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072390400:12345-0@lo:400:kworker.0 Request processed in 120us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482955.197296:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788482955.197361:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482955.197407:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072390528:0@lo:400:kworker.0 00000100:00100000:0.0:1788482955.197460:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482955.197492:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072390528 00000100:00100000:0.0:1788482955.197501:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072390528 00000100:00100000:0.0:1788482955.197563:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788482955.197571:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072390528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482955.197607:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072390528:12345-0@lo:400:kworker.0 Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482955.197614:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788482955.197657:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937057100 x1875360072390528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482955.197670:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072390528:0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.198045:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072390016 00000100:00100000:3.0:1788482955.198050:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072390016 00000100:00100000:3.0:1788482955.198072:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788482955.198081:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072390144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.198138:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072390144:12345-0@lo:400:kworker.0 Request processed in 58us (3946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482955.198145:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788482955.198163:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788482955.198169:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072390016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.198214:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072390016:12345-0@lo:400:kworker.0 Request processed in 45us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482955.198220:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788482955.198266:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482955.198271:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482955.198275:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482955.198307:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.198339:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072389888:0@lo:400:kworker.0 00000100:00100000:3.0:1788482955.198353:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072390400:0@lo:400:kworker.0 00000100:00100000:0.0:1788482955.198485:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072390016:0@lo:400:kworker.0 00000001:02000400:3.0:1788482955.555061:0:11451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:49:14 (1788482954) === 00000100:00100000:0.0:1788482955.698906:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072390656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482955.699005:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482955.699157:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072390656 00000100:00100000:0.0:1788482955.699168:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072390656 00000100:00100000:0.0:1788482955.699511:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788482955.699524:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072390656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788482955.699574:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788482955.699634:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072390656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482955.699643:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788482955.699818:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb903112300 x1875360072390656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482955.699845:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072390656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482955.734620:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482955.734683:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482955.734757:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063963648 00000100:00100000:1.0:1788482955.734773:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063963648 00000100:00100000:1.0:1788482955.734862:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1788482955.734888:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aa30c745-265d-4a44-8753-67e411452897+6:9681:x1875360063963648:12345-192.168.201.6@tcp:700:mkdir.0 00000100:00100000:1.0:1788482955.735005:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aa30c745-265d-4a44-8753-67e411452897+6:9681:x1875360063963648:12345-192.168.201.6@tcp:700:mkdir.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482955.735014:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00080000:1.0:1788482955.735043:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482955.735141:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063963520 00000100:00100000:3.0:1788482955.735147:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063963520 00000100:00100000:3.0:1788482955.735185:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1788482955.735207:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063963520:12345-192.168.201.6@tcp:41:mkdir.0 00000004:00000024:3.0:1788482955.735280:0:6958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788482955.735347:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:2354:x1875360063963520:12345-192.168.201.6@tcp:41:mkdir.0 Request processed in 155us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482955.735355:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1788482955.744516:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482955.744573:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063963904 00000100:00100000:2.0:1788482955.744589:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063963904 00000100:00100000:2.0:1788482955.744662:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:2.0:1788482955.744677:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:9681:x1875360063963904:12345-192.168.201.6@tcp:36:mkdir.0 00010000:00010000:2.0:1788482955.744769:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482955.744814:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad78b22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077912 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.746643:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9050b3900) 00010000:00010000:2.0:1788482955.746663:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788482955.747144:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.747162:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.747176:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.748689:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.748729:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.748743:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482955.750753:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788482955.750786:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.750799:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.750809:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.750815:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482955.750832:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.750843:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.750870:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb911fa9000) 00010000:00010000:2.0:1788482955.750874:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482955.750880:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482955.750888:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78c41 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788482955.750917:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbe22d82 reply state 000000001b2b832f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482955.750931:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788482955.751141:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+7:9681:x1875360063963904:12345-192.168.201.6@tcp:36:mkdir.0 Request processed in 6460us (6643us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788482955.751155:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:3.0:1788482955.756358:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.756385:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.756396:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.756403:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482955.756410:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.756420:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.756450:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eb911fa9800) 00010000:00010000:3.0:1788482955.756454:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482955.756461:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.756468:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78c48 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482955.767325:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482955.767372:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063964032 00000100:00100000:3.0:1788482955.767387:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063964032 00000100:00100000:3.0:1788482955.767458:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788482955.767471:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+6:9682:x1875360063964032:12345-192.168.201.6@tcp:101:chmod.0 00010000:00010000:3.0:1788482955.767512:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482955.767546:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492200/0x42820277aad78c4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077997 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.767650:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78c56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.767669:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.767683:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482955.767778:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788482955.767783:0:6958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788482955.767846:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78c56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.767879:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492200/0x42820277aad78c4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077997 expref: 8 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.767902:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78c56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077997 expref: 7 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.767926:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231eb900) 00010000:00010000:3.0:1788482955.767930:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788482955.767935:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492a00, rc 0) 00000100:00100000:3.0:1788482955.768017:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+7:9682:x1875360063964032:12345-192.168.201.6@tcp:101:chmod.0 Request processed in 549us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482955.768025:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788482955.774133:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482955.774181:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063964288 00000100:00100000:3.0:1788482955.774209:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063964288 00000100:00100000:3.0:1788482955.774303:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788482955.774317:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+7:9682:x1875360063964288:12345-192.168.201.6@tcp:36:chmod.0 00010000:00010000:3.0:1788482955.774394:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482955.776344:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78c56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077997 expref: 7 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.776382:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231eb900) 00010000:00010000:3.0:1788482955.776411:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788482955.776759:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.776779:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.776791:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788482955.779583:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6fd59e8 reply state 0000000052beeaef transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482955.779618:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788482955.779659:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788482955.779824:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+8:9682:x1875360063964288:12345-192.168.201.6@tcp:36:chmod.0 Request processed in 5504us (5702us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788482955.779836:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00010000:00010000:3.0:1788482955.784081:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.784108:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.784118:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.784124:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482955.784130:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.784140:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.784166:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebb00) 00010000:00010000:3.0:1788482955.784170:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788482955.784175:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.784182:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78c5d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482955.809682:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482955.809876:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063964416 00000100:00100000:1.0:1788482955.809893:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063964416 00000100:00100000:1.0:1788482955.809973:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788482955.809988:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+7:9683:x1875360063964416:12345-192.168.201.6@tcp:101:chown.0 00010000:00010000:1.0:1788482955.810022:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482955.810053:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78c64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe707799e expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.810140:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78c6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.810155:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.810167:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482955.810630:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788482955.810637:0:6958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788482955.810698:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.811029:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78c64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707799e expref: 9 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.811056:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707799e expref: 8 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.811066:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9050b3100) 00010000:00010000:0.0:1788482955.811069:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788482955.811073:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627600, rc 0) 00000100:00100000:0.0:1788482955.811180:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+8:9683:x1875360063964416:12345-192.168.201.6@tcp:101:chown.0 Request processed in 1195us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482955.811189:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:3.0:1788482955.819575:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482955.819814:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063964544 00000100:00100000:0.0:1788482955.819831:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063964544 00000100:00100000:0.0:1788482955.819927:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1788482955.819946:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+8:9683:x1875360063964544:12345-192.168.201.6@tcp:101:chown.0 00010000:00010000:0.0:1788482955.819982:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482955.820016:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78c72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779a5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.820110:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.820128:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.820166:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.820188:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.820197:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.820204:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.820872:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78c87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.820886:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.820897:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482955.820986:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788482955.820993:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482955.821029:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821046:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821054:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821063:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821071:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482955.821076:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821086:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821103:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9050b3100) 00010000:00010000:1.0:1788482955.821107:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482955.821113:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821120:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78c79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821152:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821171:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821178:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821185:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482955.821188:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821467:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821477:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eb907174900) 00010000:00010000:1.0:1788482955.821480:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482955.821483:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821490:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78c80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821557:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78c72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779a5 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821577:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779a5 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.821587:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:1.0:1788482955.821590:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788482955.821600:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626000, rc 0) 00000100:00100000:1.0:1788482955.821721:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+9:9683:x1875360063964544:12345-192.168.201.6@tcp:101:chown.0 Request processed in 1777us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482955.821733:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788482955.826756:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482955.833903:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063964800 00000100:00100000:1.0:1788482955.833930:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063964800 00000100:00100000:1.0:1788482955.834031:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788482955.834044:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+9:9683:x1875360063964800:12345-192.168.201.6@tcp:36:chown.0 00010000:00010000:1.0:1788482955.834141:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482955.834459:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78c87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779a5 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.834488:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:1.0:1788482955.834515:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788482955.834559:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.834576:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.834590:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788482955.877238:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788482955.877534:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000294cd609 reply state 000000006ee364b8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482955.877558:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788482955.877850:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1788482955.878048:0:5809:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788482955.878070:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+7:9683:x1875360063964800:12345-192.168.201.6@tcp:36:chown.0 Request processed in 44023us (51327us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788482955.878086:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00010000:00010000:3.0:1788482955.878220:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.878232:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.878241:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.878270:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482955.878276:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.878286:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.878309:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb9050b3f00) 00010000:00010000:3.0:1788482955.878313:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788482955.878319:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482955.878325:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78c8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482955.888212:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482955.888474:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063964928 00000100:00100000:2.0:1788482955.888491:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063964928 00000100:00100000:2.0:1788482955.888592:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:2.0:1788482955.888606:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+6:9684:x1875360063964928:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:2.0:1788482955.888648:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482955.888683:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78c95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788482955.891947:0:5807:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3152us 00010000:00010000:0.0:1788482955.903259:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.903287:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.903299:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.903313:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.903318:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.903322:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904322:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78caa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904342:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904351:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482955.904436:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788482955.904441:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788482955.904573:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904587:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904594:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904600:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904605:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482955.904610:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904618:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904635:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9050b3100) 00010000:00010000:0.0:1788482955.904639:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482955.904647:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904666:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78c9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904688:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904692:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904696:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904699:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482955.904701:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904704:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904709:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eb907174700) 00010000:00010000:0.0:1788482955.904711:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482955.904713:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.904942:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78ca3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.905000:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78c95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779ac expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.905014:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78caa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779ac expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.905025:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788482955.905027:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788482955.905029:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369000, rc 0) 00000100:00100000:0.0:1788482955.905135:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+7:9684:x1875360063964928:12345-192.168.201.6@tcp:101:touch.500 Request processed in 16531us (16942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482955.905145:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:1.0:1788482955.907792:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482955.907933:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063965184 00000100:00100000:0.0:1788482955.907946:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063965184 00000100:00100000:0.0:1788482955.908021:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1788482955.908031:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+7:9684:x1875360063965184:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:0.0:1788482955.908054:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482955.908077:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78cb1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779b3 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.908511:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.908530:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.908543:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.908719:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.908742:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.908773:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788482955.914564:0:6958:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788482955.915008:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78cc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915027:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915040:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915077:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915082:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915088:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915092:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482955.915096:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915102:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915113:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788482955.915116:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482955.915126:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915130:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78cb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788482955.915149:0:6958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcd908f5 reply state 00000000060b7b1a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482955.915158:0:6958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788482955.915203:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78cb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779b3 expref: 10 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915220:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779b3 expref: 9 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.915228:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eb907174700) 00010000:00010000:0.0:1788482955.915230:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788482955.915233:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369c00, rc 0) 00000100:00100000:0.0:1788482955.915373:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+10:9684:x1875360063965184:12345-192.168.201.6@tcp:101:touch.500 Request processed in 7341us (7595us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788482955.915382:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:3.0:1788482955.920471:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482955.920730:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063965440 00000100:00100000:1.0:1788482955.920744:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063965440 00000100:00100000:1.0:1788482955.920833:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:1.0:1788482955.920847:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+10:9684:x1875360063965440:12345-192.168.201.6@tcp:36:touch.500 00010000:00010000:0.0:1788482955.920947:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.920965:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.920973:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.921004:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482955.921010:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.921018:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.921038:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9eb907174b00) 00010000:00010000:0.0:1788482955.921040:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482955.921044:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482955.921049:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78cbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.921060:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482955.921096:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78cc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779b3 expref: 9 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.921132:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eb907174700) 00010000:00010000:1.0:1788482955.921145:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788482955.921216:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.921235:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.921286:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788482955.921520:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be6bba4e reply state 00000000e834401f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482955.921534:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788482955.921691:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+10:9684:x1875360063965440:12345-192.168.201.6@tcp:36:touch.500 Request processed in 846us (1238us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788482955.921700:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00010000:00010000:1.0:1788482955.928363:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.928399:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.928409:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.928416:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482955.928423:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.928434:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.928464:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:1.0:1788482955.928467:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482955.928474:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.928480:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78cd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482955.929807:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482955.930010:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063965568 00000100:00100000:1.0:1788482955.930030:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063965568 00000100:00100000:1.0:1788482955.930122:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1788482955.930140:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+9:9684:x1875360063965568:12345-192.168.201.6@tcp:101:touch.500 00010000:00010000:1.0:1788482955.930184:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482955.930217:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad78cdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779ba expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.930380:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad78cdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779ba expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.930399:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad78cdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779ba expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482955.930426:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eb9050b3000) 00010000:00010000:1.0:1788482955.930429:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788482955.930435:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627000, rc 0) 00000100:00100000:1.0:1788482955.930536:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+10:9684:x1875360063965568:12345-192.168.201.6@tcp:101:touch.500 Request processed in 402us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482955.930556:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:3.0:1788482955.936569:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482955.936763:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063965696 00000100:00100000:1.0:1788482955.936781:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063965696 00000100:00100000:1.0:1788482955.936851:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788482955.936934:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875360063965696:12345-192.168.201.6@tcp:8:touch.500 00010000:00080000:1.0:1788482955.936981:0:6663:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:1.0:1788482955.937023:0:6663:0:(genops.c:1385:class_connect()) connect: client aa30c745-265d-4a44-8753-67e411452897, cookie 0x42820277aad78ce2 00002000:00100000:1.0:1788482955.937038:0:6663:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa30c745-265d-4a44-8753-67e411452897/ffff9eb93ff2b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788482955.937068:0:6663:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:1.0:1788482955.937420:0:6663:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788482955.937460:0:6663:0:(import.c:65:import_set_state_nolock()) ffff9eb93ff28800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788482955.937569:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+6:2350:x1875360063965696:12345-192.168.201.6@tcp:8:touch.500 Request processed in 705us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482955.937590:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1788482955.944631:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482955.944751:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063965824 00000100:00100000:1.0:1788482955.944773:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063965824 00000100:00080000:3.0:1788482955.944872:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482955.944927:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1788482955.944944:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:0:x1875360063965824:12345-192.168.201.6@tcp:2:touch.500 00000001:00080000:3.0:1788482956.004621:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1788482956.004642:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000100:00100000:2.0:1788482956.004911:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:0:x1875360063965824:12345-192.168.201.6@tcp:2:touch.500 Request processed in 59962us (64702us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788482956.004925:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788482956.009692:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482956.011729:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063966080 00000100:00100000:1.0:1788482956.011748:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063966080 00000100:00100000:1.0:1788482956.011858:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1788482956.011871:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+10:9684:x1875360063966080:12345-192.168.201.6@tcp:35:touch.500 00000100:00100000:1.0:1788482956.012360:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+11:9684:x1875360063966080:12345-192.168.201.6@tcp:35:touch.500 Request processed in 491us (2682us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788482956.012368:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1788482956.027125:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482956.027391:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063966208 00000100:00100000:1.0:1788482956.027404:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063966208 00000100:00100000:1.0:1788482956.027478:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:1.0:1788482956.027500:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+11:9685:x1875360063966208:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:1.0:1788482956.027540:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482956.027569:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78ce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779c1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.027662:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78cf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.027680:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.027693:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482956.027952:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788482956.027957:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482956.028009:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.028046:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78ce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779c1 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.028074:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779c1 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.028099:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174600) 00010000:00010000:1.0:1788482956.028103:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788482956.028107:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627a00, rc 0) 00000100:00100000:1.0:1788482956.028362:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+12:9685:x1875360063966208:12345-192.168.201.6@tcp:101:rm.0 Request processed in 872us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482956.028370:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:0.0:1788482956.037718:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482956.037859:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063966464 00000100:00100000:3.0:1788482956.037879:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063966464 00000100:00100000:3.0:1788482956.037978:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:3.0:1788482956.037993:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+12:9685:x1875360063966464:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:3.0:1788482956.038026:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482956.038057:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78cf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779c8 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482956.038511:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788482956.039474:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78cf7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779c8 expref: 14 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.039539:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9050b3100) 00010000:00010000:2.0:1788482956.039543:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788482956.039549:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78cf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779c8 expref: 14 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.039571:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493600, rc 0) 00000100:00100000:2.0:1788482956.039674:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+13:9685:x1875360063966464:12345-192.168.201.6@tcp:101:rm.0 Request processed in 1682us (1965us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788482956.039686:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:2.0:1788482956.046143:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482956.046419:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063966592 00000100:00100000:3.0:1788482956.046435:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063966592 00000100:00100000:3.0:1788482956.046514:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1788482956.046527:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+13:9685:x1875360063966592:12345-192.168.201.6@tcp:37:rm.0 00000100:00100000:1.0:1788482956.052055:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+13:9685:x1875360063966592:12345-192.168.201.6@tcp:37:rm.0 Request processed in 5512us (5909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482956.052075:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:0.0:1788482956.060655:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482956.060771:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063966848 00000100:00100000:2.0:1788482956.060847:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063966848 00000100:00100000:2.0:1788482956.060928:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788482956.060941:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb91888ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+13:9685:x1875360063966848:12345-192.168.201.6@tcp:35:rm.0 00000100:00100000:2.0:1788482956.061540:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb91888ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+14:9685:x1875360063966848:12345-192.168.201.6@tcp:35:rm.0 Request processed in 599us (897us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788482956.061558:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:2.0:1788482956.067972:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482956.068229:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063967104 00000100:00100000:3.0:1788482956.068242:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063967104 00000100:00100000:2.0:1788482956.069185:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1788482956.069198:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+14:9685:x1875360063967104:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:2.0:1788482956.069225:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482956.069270:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad78d05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779cf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.069394:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad78d0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.069408:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad78d0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.069420:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad78d0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482956.069433:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788482956.069622:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad78d05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779cf expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.069647:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad78d0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779cf expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.069656:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174600) 00010000:00010000:2.0:1788482956.069659:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788482956.069663:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781200, rc 0) 00000100:00100000:2.0:1788482956.069743:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+16:9685:x1875360063967104:12345-192.168.201.6@tcp:101:rm.0 Request processed in 546us (1784us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788482956.069772:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1788482956.077901:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482956.078068:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063967232 00000100:00100000:1.0:1788482956.078084:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063967232 00000100:00100000:1.0:1788482956.078166:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1788482956.078179:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+16:9685:x1875360063967232:12345-192.168.201.6@tcp:41:rm.0 00000004:00000024:1.0:1788482956.078302:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788482956.078504:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+16:9685:x1875360063967232:12345-192.168.201.6@tcp:41:rm.0 Request processed in 327us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482956.078529:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:0.0:1788482956.086755:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482956.086993:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063967360 00000100:00100000:1.0:1788482956.087005:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063967360 00000100:00100000:1.0:1788482956.087125:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:1.0:1788482956.087139:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+16:9685:x1875360063967360:12345-192.168.201.6@tcp:101:rm.0 00010000:00010000:1.0:1788482956.087167:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482956.087194:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78d1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779d6 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.088945:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.088973:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.088987:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089008:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089016:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089042:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089203:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368a00/0x42820277aad78d2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089212:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368a00/0x42820277aad78d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089220:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368a00/0x42820277aad78d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482956.089271:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788482956.089276:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788482956.089300:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368a00/0x42820277aad78d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089310:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368a00/0x42820277aad78d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089317:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089321:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089326:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089330:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482956.089333:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089343:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089354:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788482956.089356:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482956.089360:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089364:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089384:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089388:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089392:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089394:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482956.089396:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089399:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089402:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9eb907174f00) 00010000:00010000:0.0:1788482956.089404:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482956.089405:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089415:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089462:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626000/0x42820277aad78d1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779d6 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089480:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368a00/0x42820277aad78d2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779d6 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.089488:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eb9050b3000) 00010000:00010000:0.0:1788482956.089502:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788482956.089504:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368a00, rc 0) 00000100:00100000:0.0:1788482956.089595:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+17:9685:x1875360063967360:12345-192.168.201.6@tcp:101:rm.0 Request processed in 2458us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482956.089604:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:3.0:1788482956.094324:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482956.094410:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063967616 00000100:00100000:1.0:1788482956.094424:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063967616 00000100:00100000:1.0:1788482956.094520:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788482956.094534:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+17:9685:x1875360063967616:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:1.0:1788482956.094604:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788482956.094636:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368a00/0x42820277aad78d2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779d6 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.094672:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad78cdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779ba expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.094685:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eb9050b3000) 00010000:00010000:1.0:1788482956.094705:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78cf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779c1 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.094714:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174600) 00010000:00010000:1.0:1788482956.094718:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788482956.094770:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.094802:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.094813:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.094829:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.094833:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.094838:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.095015:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.095020:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.095025:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788482956.097110:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788482956.097131:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 273262881066ns, next at 274262876996ns, rc = 0 00010000:00010000:0.0:1788482956.097413:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097565:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097578:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097589:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097611:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097618:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097693:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788482956.097731:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097736:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097743:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097748:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482956.097753:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097762:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097778:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:0.0:1788482956.097781:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788482956.097788:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097794:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad78d44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097820:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097834:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097839:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097845:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482956.097848:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097854:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097863:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788482956.097865:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482956.097868:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.097873:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78d36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788482956.097885:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3eb52d0 reply state 00000000b3a97bec transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482956.097907:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788482956.098050:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+16:9685:x1875360063967616:12345-192.168.201.6@tcp:36:rm.0 Request processed in 3514us (3734us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788482956.098059:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00010000:00010000:2.0:1788482956.099522:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482956.099540:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.099550:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788482956.099555:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.099563:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.099580:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:2.0:1788482956.099583:0:8489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788482956.099586:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.099593:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78d4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482956.099623:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482956.099625:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482956.099627:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482956.102278:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.102319:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.102328:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.102335:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482956.102341:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.102350:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.102370:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff9eb9050b3500) 00010000:00010000:0.0:1788482956.102374:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482956.102378:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.102386:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78d3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482956.106226:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482956.106675:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063967872 00000100:00100000:1.0:1788482956.106694:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063967872 00000100:00100000:1.0:1788482956.106802:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788482956.106817:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+15:9685:x1875360063967872:12345-192.168.201.6@tcp:35:rm.0 00000100:00100000:1.0:1788482956.108626:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+16:9685:x1875360063967872:12345-192.168.201.6@tcp:35:rm.0 Request processed in 1798us (2849us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788482956.108671:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788482956.125444:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482956.127019:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063968128 00000100:00100000:0.0:1788482956.127034:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063968128 00000100:00100000:0.0:1788482956.127110:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1788482956.127120:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+16:9685:x1875360063968128:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:0.0:1788482956.127195:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788482956.127228:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad78d0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779cf expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127311:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78caa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779ac expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127334:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788482956.127354:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78c6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707799e expref: 14 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127364:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9050b3100) 00010000:00010000:0.0:1788482956.127372:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788482956.127400:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127412:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127420:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127431:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127438:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127444:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127828:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127847:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.127852:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482956.128545:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788482956.128568:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128577:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128586:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128592:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482956.128597:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128606:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128617:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9eb907174400) 00010000:00010000:0.0:1788482956.128619:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788482956.128622:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128627:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78d60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128649:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128659:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128663:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128665:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482956.128667:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128670:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128675:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb907174f00) 00010000:00010000:0.0:1788482956.128676:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482956.128678:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.128681:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78d52 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788482956.128690:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c8e3607 reply state 0000000096661474 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482956.128699:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788482956.128802:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+15:9685:x1875360063968128:12345-192.168.201.6@tcp:36:rm.0 Request processed in 1679us (3384us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788482956.128812:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00010000:00010000:1.0:1788482956.134543:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.134563:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.134572:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.134578:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482956.134583:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.134591:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.134609:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9eb907174b00) 00010000:00010000:1.0:1788482956.134612:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482956.134618:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482956.134624:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad78d59 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482956.148756:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482956.723223:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072390784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482956.723365:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482956.723609:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072390784 00000100:00100000:3.0:1788482956.723620:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072390784 00000100:00100000:3.0:1788482956.723696:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788482956.723718:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072390784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788482956.723746:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482956.723805:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072390784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482956.723813:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788482956.724490:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb9406f5180 x1875360072390784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482956.724529:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072390784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482957.172234:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482957.797605:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482957.797694:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482957.797769:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482957.797838:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063968256 00000100:00100000:1.0:1788482957.797857:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063968256 00000100:00100000:1.0:1788482957.798035:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 250 00000100:00100000:1.0:1788482957.798059:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360063968256:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482957.798181:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360063968256:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 125us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482957.798189:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 250 00000100:00100000:3.0:1788482957.802359:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482957.802408:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063968512 00000100:00100000:3.0:1788482957.802422:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063968512 00000100:00100000:3.0:1788482957.802521:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1788482957.802535:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063968512:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482957.802628:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063968512:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 96us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.802635:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00080000:3.0:1788482957.802669:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482957.807262:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063968384 00000100:00100000:0.0:1788482957.807282:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063968384 00000100:00100000:0.0:1788482957.807381:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063968640 00000100:00100000:0.0:1788482957.807384:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063968640 00000100:00100000:0.0:1788482957.807417:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:0.0:1788482957.807430:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+14:2352:x1875360063968384:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482957.807566:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+14:2352:x1875360063968384:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 138us (9881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482957.807576:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:3.0:1788482957.807758:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063968640:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482957.807861:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063968640:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 51us (10034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482957.809651:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:3.0:1788482957.809660:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00080000:3.0:1788482957.809767:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788482958.194564:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482959.218565:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788482960.082768:0:11600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788482960.247233:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482960.306945:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072391040:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307054:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482960.307152:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072391552:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307197:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482960.307239:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788482960.307271:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072390912:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307306:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482960.307335:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072391424:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307358:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482960.307389:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072391168:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307416:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482960.307470:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482960.307477:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072391296:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307503:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482960.307556:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072390912 00000100:00100000:0.0:1788482960.307567:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072390912 00000100:00100000:0.0:1788482960.307633:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788482960.307644:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072390912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307708:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072390912:12345-0@lo:400:kworker.0 Request processed in 64us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482960.307717:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788482960.307761:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072391040 00000100:00100000:0.0:1788482960.307764:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072391040 00000100:00100000:0.0:1788482960.307792:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072391424 00000100:00100000:0.0:1788482960.307795:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072391424 00000100:00100000:0.0:1788482960.307821:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072391168 00000100:00100000:0.0:1788482960.307824:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072391168 00000100:00100000:0.0:1788482960.307839:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788482960.307845:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072391040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307881:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072391040:12345-0@lo:400:kworker.0 Request processed in 35us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482960.307887:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788482960.307901:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788482960.307907:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072391424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.307934:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072391424:12345-0@lo:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482960.307940:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788482960.307952:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788482960.307959:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072391168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.308002:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072391168:12345-0@lo:400:kworker.0 Request processed in 44us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482960.308008:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788482960.308030:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072391552 00000100:00100000:0.0:1788482960.308034:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072391552 00000100:00100000:0.0:1788482960.308060:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072391296 00000100:00100000:0.0:1788482960.308063:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072391296 00000100:00100000:0.0:1788482960.308081:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788482960.308088:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072391552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.308123:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072391552:12345-0@lo:400:kworker.0 Request processed in 36us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482960.308130:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788482960.308142:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788482960.308148:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072391296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.308174:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072391296:12345-0@lo:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482960.308180:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788482960.308230:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb937265180 x1875360072391296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482960.308284:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072391296:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.308300:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072391168:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.308337:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072390912:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.308351:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072391424:0@lo:400:kworker.0 00000100:00100000:0.0:1788482960.308363:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93728d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072391040:0@lo:400:kworker.0 00010000:00080000:0.0:1788482960.308382:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb92eb47100 x1875360072391552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482960.308392:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072391552:0@lo:400:kworker.0 00000100:00080000:3.0:1788482960.309234:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788482960.309242:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482960.309246:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482960.819174:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072391680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482960.819316:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482960.819545:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072391680 00000100:00100000:3.0:1788482960.819558:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072391680 00000100:00100000:3.0:1788482960.819643:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788482960.819659:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072391680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788482960.819955:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482960.820042:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072391680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 385us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482960.820066:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788482960.820171:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb908703100 x1875360072391680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482960.820193:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072391680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482961.272592:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788482961.386845:0:11648:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9a50d5b0 20000000:00000080:0.0:1788482961.386873:0:11648:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eb93fe45400 uarg=0000000000000000 20000000:01000000:0.0:1788482961.386933:0:11648:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788482961.386942:0:11648:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788482961.386948:0:11648:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788482961.393238:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788482961.393439:0:11648:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000001:00080000:1.0:1788482961.403310:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788482961.403342:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788482961.403816:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072391808:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788482961.404014:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482961.404066:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072391808 00000100:00100000:0.0:1788482961.404080:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072391808 00000100:00100000:0.0:1788482961.404157:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788482961.404169:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072391808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788482961.404204:0:6663:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788482961.404246:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9a158c, atime: 0x6a9a158c, ctime: 0x6a9a158c, blocks: 0x1 00010000:00010000:0.0:1788482961.404299:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.404334:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=278s v=(0 0) 00010000:00010000:0.0:1788482961.404339:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482961.404346:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.404365:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.404377:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.404386:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.404415:0:6663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788482961.405876:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072391808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1700us (1858us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788482961.405901:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788482961.406187:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482961.406199:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.406215:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788482961.406222:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.406281:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.406305:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.406314:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad78d67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.406341:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482961.406343:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482961.406345:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788482961.406602:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb937056300/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788482961.406612:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072391808:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1788482961.407233:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788482961.407367:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788482961.407453:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788482961.407476:0:11648:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788482961.407497:0:11648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.407518:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.407528:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.407537:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78c17 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.407559:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78c25 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.407567:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78c33 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.407574:0:11648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.407864:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78c33 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.409137:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78c33 expref: 18 pid: 5800 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482961.409170:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072391936:0@lo:104: 00000100:00100000:1.0:1788482961.409416:0:11648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482961.409518:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78c25 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482961.409534:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78c25 expref: 18 pid: 5801 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482961.409549:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072392064:0@lo:104: 00000100:00100000:1.0:1788482961.409593:0:11648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482961.409631:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad78c17 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482961.409640:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad78c17 expref: 18 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482961.409652:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937054e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072392192:0@lo:104: 00000100:00100000:1.0:1788482961.409684:0:11648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482961.409686:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072391936 00000100:00100000:2.0:1788482961.409720:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072391936 00000100:00100000:2.0:1788482961.410545:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788482961.410556:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482961.410573:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072392064 00010000:00010000:1.0:1788482961.410579:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 12 pid: 5802 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482961.410584:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072392064 00000100:00100000:1.0:1788482961.410613:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072392320:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482961.410617:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072392192 00000100:00100000:2.0:1788482961.410623:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072392192 00000100:00100000:2.0:1788482961.410652:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482961.410667:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:11648:x1875360072391936:12345-0@lo:104: 00010000:00010000:2.0:1788482961.410688:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482961.410709:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482961.410722:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 12 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482961.410731:0:11648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937057100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072392448:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788482961.410767:0:11648:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034180 going to sleep for 11 seconds 00000100:00100000:1.0:1788482961.410798:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072391936:0@lo:104: 00000100:00100000:3.0:1788482961.410831:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788482961.410845:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:11648:x1875360072392064:12345-0@lo:104: 00010000:00010000:3.0:1788482961.410861:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482961.411070:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788482961.411078:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937057b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+5:11648:x1875360072391936:12345-0@lo:104: Request processed in 415us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482961.411086:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788482961.411109:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788482961.411116:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93febe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:11648:x1875360072392192:12345-0@lo:104: 00010000:00010000:2.0:1788482961.411124:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482961.411175:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788482961.411180:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93febe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+4:11648:x1875360072392192:12345-0@lo:104: Request processed in 65us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482961.411186:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788482961.411469:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788482961.411480:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411488:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369600 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788482961.411494:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411503:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482961.411512:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482961.411535:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788482961.411578:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411586:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482961.411614:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411621:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78c33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c3a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411637:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482961.411641:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411647:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492e00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788482961.411650:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411657:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482961.411664:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482961.411669:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788482961.411685:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411690:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482961.411703:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411710:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb901492e00/0x42820277aad78c17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.411736:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482961.411738:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482961.411740:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482961.411750:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482961.411770:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072392576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482961.411822:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482961.411848:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937054e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072392192:0@lo:104: 00000100:00100000:0.0:1788482961.411888:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788482961.411898:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072392704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482961.411923:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482961.411970:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072392576 00000100:00100000:0.0:1788482961.411975:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072392576 00010000:00010000:0.0:1788482961.412004:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78c33 expref: 19 pid: 5800 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482961.412027:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072392704 00000100:00100000:0.0:1788482961.412030:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072392704 00010000:00010000:0.0:1788482961.412041:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78c17 expref: 20 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482961.412060:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788482961.412067:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+20:3279:x1875360072392576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482961.412079:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482961.412085:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78c33 expref: 20 pid: 5800 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.412110:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78c33 expref: 20 pid: 5800 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.412127:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f626600/0x42820277aad78c3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78c33 expref: 20 pid: 5800 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.412142:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482961.412173:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072392576:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482961.412180:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788482961.412199:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788482961.412205:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:3279:x1875360072392704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482961.412213:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482961.412217:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78c17 expref: 18 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.412225:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78c17 expref: 18 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.412235:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f626c00/0x42820277aad78c1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78c17 expref: 18 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.412244:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482961.412292:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3279:x1875360072392704:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482961.412299:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788482961.412337:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072392704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482961.412345:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072392576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788482961.412940:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788482961.412951:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+3:11648:x1875360072392064:12345-0@lo:104: Request processed in 2108us (3354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482961.412963:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788482961.413008:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072392064:0@lo:104: 00010000:00010000:0.0:1788482961.413086:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482961.413095:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.413103:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627c00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788482961.413108:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.413117:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788482961.413125:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482961.413131:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788482961.413459:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.413467:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788482961.413492:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.413499:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f627c00/0x42820277aad78c25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad78c2c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.413517:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482961.413518:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482961.413520:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482961.413528:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788482961.413542:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072392832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788482961.413598:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482961.413649:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072392832 00000100:00100000:0.0:1788482961.413655:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072392832 00010000:00010000:0.0:1788482961.413681:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78c25 expref: 17 pid: 5801 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482961.413706:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788482961.413714:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3278:x1875360072392832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788482961.413737:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482961.413744:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad78c25 expref: 17 pid: 5801 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.413757:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad78c25 expref: 17 pid: 5801 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.413772:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb907368c00/0x42820277aad78c2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad78c25 expref: 17 pid: 5801 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.413785:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482961.413820:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3278:x1875360072392832:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482961.413827:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788482961.413889:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072392832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788482961.415203:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482961.415339:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482961.415386:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063968768 00000100:00100000:0.0:1788482961.415409:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063968768 00010000:00010000:0.0:1788482961.415452:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 13 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482961.415497:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063968896 00000100:00100000:0.0:1788482961.415516:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063968896 00010000:00010000:0.0:1788482961.415533:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 14 pid: 5802 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482961.415563:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1788482961.415576:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+14:2351:x1875360063968768:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482961.415591:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788482961.415596:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00010000:00010000:0.0:1788482961.415604:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 14 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482961.415625:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 14 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482961.415626:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4e829f8-ccd7-488a-828b-8ba668cc410b+14:2352:x1875360063968896:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482961.415657:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482961.415660:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788482961.415672:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 14 pid: 5802 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415691:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 14 pid: 5802 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415714:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415723:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415741:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415770:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415777:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415784:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415790:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788482961.415795:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415802:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415812:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482961.415821:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482961.415911:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4e829f8-ccd7-488a-828b-8ba668cc410b+14:2351:x1875360063968768:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 336us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482961.415921:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00010000:00010000:2.0:1788482961.418435:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492800/0x42820277aad78c10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077990 expref: 13 pid: 5802 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482961.418458:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072392320:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788482961.418477:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901493a00/0x42820277aad78c09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077989 expref: 12 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482961.418501:0:11648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937057100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1875360072392448:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788482961.418540:0:11648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482961.418549:0:11648:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482961.418555:0:11648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482961.418562:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb907368e00/0x42820277aad78d6e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482961.427868:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:2352:x1875360063968896:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 12247us (12517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482961.428042:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1788482961.843158:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482961.843190:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072392960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482961.843320:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482961.843795:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072392960 00000100:00100000:2.0:1788482961.843805:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072392960 00000100:00100000:2.0:1788482961.849664:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788482961.849691:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875360072392960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482961.849736:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482961.850091:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875360072392960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 414us (6770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482961.850099:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788482961.850209:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072392960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482962.290603:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482962.920542:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482962.920712:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482962.920751:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482962.920941:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482962.925038:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063969024 00000100:00100000:3.0:1788482962.925067:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063969024 00000100:00100000:3.0:1788482962.925189:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 252 00000100:00100000:3.0:1788482962.925203:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:2351:x1875360063969024:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482962.925392:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:2351:x1875360063969024:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 191us (4679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.925427:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 252 00000100:00100000:1.0:1788482962.930954:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063969280 00000100:00100000:1.0:1788482962.930978:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063969280 00000100:00100000:1.0:1788482962.931112:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:1.0:1788482962.931136:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063969280:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482962.931294:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063969280:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 162us (10542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482962.931333:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00080000:3.0:1788482962.932111:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482962.933692:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063969152 00000100:00100000:0.0:1788482962.933711:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063969152 00000100:00100000:0.0:1788482962.933821:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063969408 00000100:00100000:0.0:1788482962.933835:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063969408 00000100:00100000:0.0:1788482962.933887:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:0.0:1788482962.933899:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063969152:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482962.934010:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063969152:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 113us (13492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482962.934018:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:0.0:1788482962.934041:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 111 00000100:00080000:3.0:1788482962.934437:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482962.934755:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063969408:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482962.934810:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063969408:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 60us (13870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482962.935713:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 111 10000000:01000000:2.0:1788482962.998288:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788482962.998302:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb93f7bc000 from 7 10000000:01000000:2.0:1788482962.998309:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788482962.998412:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482962.998427:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482962.998442:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482962.998479:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788482962.998581:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.998675:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91030c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482962.999270:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072393088 00000100:00100000:3.0:1788482962.999282:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072393088 00000100:00100000:3.0:1788482962.999358:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788482962.999380:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:5804:x1875360072393088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788482962.999398:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482962.999418:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb901492200/0x42820277aad78d7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78d75 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482962.999453:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb901492200/0x42820277aad78d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78d75 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482962.999465:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb901492200/0x42820277aad78d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78d75 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482962.999476:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492200, rc 0) 00000100:00100000:3.0:1788482962.999546:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072393088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482962.999554:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788482962.999781:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482962.999805:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482962.999817:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482962.999905:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482962.999938:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482962.999978:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91030c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788482963.001424:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072393216 00000100:00100000:3.0:1788482963.001440:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072393216 00000100:00100000:3.0:1788482963.001522:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788482963.001534:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072393216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788482963.001931:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072393216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 398us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482963.001952:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788482963.002512:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.002585:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.002654:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482963.002712:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91030c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788482963.002788:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072393344 00000100:00100000:0.0:1788482963.002796:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072393344 00000100:00100000:3.0:1788482963.005493:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788482963.005528:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9086c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072393344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788482963.005925:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9086c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072393344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 414us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482963.005934:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788482963.006410:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482963.008859:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11662:1875360072393472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482963.010308:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482963.010424:0:11662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482963.010539:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072393472 00000100:00100000:1.0:1788482963.010555:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072393472 00000100:00100000:1.0:1788482963.010637:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788482963.010650:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:11662:x1875360072393472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482963.012716:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:11662:x1875360072393472:12345-0@lo:502:llog_process_th.0 Request processed in 2056us (3595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482963.012736:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788482963.014369:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11662:1875360072393472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788482963.014442:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482963.014459:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482963.014462:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788482963.014470:0:11662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eb93f7bc000 00000020:00000080:0.0:1788482963.014473:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788482963.014604:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11662:1875360072393600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482963.014689:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482963.014755:0:11662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482963.022638:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072393600 00000100:00100000:1.0:1788482963.022663:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072393600 00000100:00100000:1.0:1788482963.022767:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788482963.022784:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:11662:x1875360072393600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788482963.023205:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:11662:x1875360072393600:12345-0@lo:502:llog_process_th.0 Request processed in 424us (8514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482963.023216:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788482963.023915:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11662:1875360072393600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788482963.023967:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482963.023978:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482963.023982:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788482963.023987:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788482963.024406:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788482963.024433:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788482963.024450:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482963.024464:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788482963.024479:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788482963.024482:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb906309000 from 7 10000000:01000000:1.0:1788482963.024485:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788482963.024549:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482963.024573:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482963.024586:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482963.024613:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788482963.024681:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482963.024738:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482963.025122:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072393728 00000100:00100000:0.0:1788482963.025132:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072393728 00000100:00100000:0.0:1788482963.025185:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788482963.025197:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:5804:x1875360072393728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482963.025221:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482963.025239:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907368c00/0x42820277aad78d8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78d83 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.025292:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907368c00/0x42820277aad78d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78d83 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.025305:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907368c00/0x42820277aad78d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78d83 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.025318:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368c00, rc 0) 00000100:00100000:0.0:1788482963.025395:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072393728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482963.025403:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788482963.026882:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482963.026916:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482963.026928:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482963.027052:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.027134:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482963.027192:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91030c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788482963.027349:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072393856 00000100:00100000:0.0:1788482963.027360:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072393856 00000100:00100000:0.0:1788482963.027423:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788482963.027435:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072393856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482963.027833:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072393856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 398us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482963.027843:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788482963.029296:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.029398:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.029490:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482963.029543:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91030c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788482963.029576:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072393984 00000100:00100000:2.0:1788482963.029584:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072393984 00000100:00100000:2.0:1788482963.029643:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788482963.029653:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9087aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072393984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.029918:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9087aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072393984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482963.029927:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788482963.029990:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072393984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.030334:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11664:1875360072394112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482963.030390:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482963.030425:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072394112 00000100:00100000:2.0:1788482963.030431:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072394112 00000100:00100000:2.0:1788482963.030455:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788482963.030464:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:11664:x1875360072394112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482963.030640:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:11664:x1875360072394112:12345-0@lo:502:llog_process_th.0 Request processed in 177us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482963.030649:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788482963.030684:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91f1afc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788482963.030697:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11664:1875360072394112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482963.030723:0:11664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788482963.030736:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482963.030740:0:11664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788482963.030747:0:11664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eb906309000 00000020:00000080:2.0:1788482963.030750:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788482963.030842:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11664:1875360072394240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482963.030876:0:11664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482963.030895:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072394240 00000100:00100000:2.0:1788482963.030898:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072394240 00000100:00100000:2.0:1788482963.030921:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788482963.030928:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:11664:x1875360072394240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788482963.035776:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:11664:x1875360072394240:12345-0@lo:502:llog_process_th.0 Request processed in 4829us (4881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482963.035797:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788482963.035920:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91f1afc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788482963.035959:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11664:1875360072394240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788482963.036020:0:11664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788482963.036045:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788482963.036049:0:11664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788482963.036055:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788482963.044164:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788482963.044272:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788482963.044288:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.044307:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788482963.044337:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788482963.044342:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb9070c3000 from 7 10000000:01000000:0.0:1788482963.044345:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788482963.045008:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.045022:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.045038:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482963.045078:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072394368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788482963.045428:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482963.045540:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034480 going to sleep for 11 seconds 00000100:00100000:2.0:1788482963.061583:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072394368 00000100:00100000:2.0:1788482963.061608:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072394368 00000100:00100000:2.0:1788482963.061697:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788482963.061711:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:5804:x1875360072394368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482963.061735:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482963.061760:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f781200/0x42820277aad78d98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad78d91 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482963.061800:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f781200/0x42820277aad78d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad78d91 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482963.061814:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f781200/0x42820277aad78d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad78d91 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482963.061825:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781200, rc 0) 00000100:00100000:2.0:1788482963.061941:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072394368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (16514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482963.061949:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788482963.066331:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072394368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788482963.066388:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482963.066405:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482963.066541:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072394496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482963.066640:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482963.066714:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788482963.066766:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072394496 00000100:00100000:1.0:1788482963.066774:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072394496 00000100:00100000:1.0:1788482963.066826:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788482963.066838:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072394496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482963.067217:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072394496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482963.067225:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788482963.067310:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072394496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788482963.067349:0:5804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072394624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482963.067410:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482963.067425:0:5804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788482963.067438:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072394624 00000100:00100000:1.0:1788482963.067442:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072394624 00000100:00100000:1.0:1788482963.067462:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788482963.067469:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072394624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788482963.067647:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:5804:x1875360072394624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482963.067654:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788482963.067691:0:5804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937054000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:5804:1875360072394624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788482963.068961:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11666:1875360072394752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482963.069054:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482963.069088:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b0346c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482963.069223:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072394752 00000100:00100000:1.0:1788482963.069232:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072394752 00000100:00100000:1.0:1788482963.069308:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788482963.069320:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:11666:x1875360072394752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482963.069677:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11666:1875360072394752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788482963.069717:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788482963.069730:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482963.069732:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788482963.069742:0:11666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eb9070c3000 00000020:00000080:0.0:1788482963.069745:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788482963.069858:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11666:1875360072394880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482963.069898:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482963.069923:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072394880 00000100:00100000:0.0:1788482963.069935:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072394880 00000100:00100000:0.0:1788482963.069963:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788482963.069970:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+20:11666:x1875360072394880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788482963.070129:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+20:11666:x1875360072394880:12345-0@lo:502:llog_process_th.0 Request processed in 159us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482963.070137:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788482963.070179:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b0346c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482963.070192:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:11666:1875360072394880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788482963.070210:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788482963.070214:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788482963.070216:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788482963.070220:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788482963.070432:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788482963.070455:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788482963.070468:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.070481:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482963.070733:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:11666:x1875360072394752:12345-0@lo:502:llog_process_th.0 Request processed in 248us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482963.070745:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000040:00080000:3.0:1788482963.095555:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788482963.292507:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482963.292710:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063969536 00000100:00100000:0.0:1788482963.292729:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063969536 00000100:00100000:0.0:1788482963.292827:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 268 00000100:00100000:0.0:1788482963.292852:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:5595:x1875360063969536:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788482963.292878:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482963.292901:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907368a00/0x42820277aad78d9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779dd expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.292969:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907368a00/0x42820277aad78d9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779dd expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.292982:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907368a00/0x42820277aad78d9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779dd expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482963.292995:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368a00, rc 0) 00000100:00100000:0.0:1788482963.293182:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063969536:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 343us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482963.293196:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 268 00000100:00100000:3.0:1788482963.303730:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482963.306805:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063969664 00000100:00100000:0.0:1788482963.306832:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063969664 00000100:00100000:0.0:1788482963.307656:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 269 00000100:00100000:0.0:1788482963.307680:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063969664:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482963.308606:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063969664:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 929us (4886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482963.308618:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 269 00000100:00100000:3.0:1788482963.312742:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482963.313919:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063969792 00000100:00100000:2.0:1788482963.313940:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063969792 00000100:00100000:2.0:1788482963.314027:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 270 00000100:00100000:2.0:1788482963.314041:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063969792:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.314907:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063969792:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 861us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482963.314920:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 270 00010000:00010000:0.0:1788482963.318414:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482963.322649:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482963.328398:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063969920 00000100:00100000:2.0:1788482963.328424:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063969920 00000100:00100000:2.0:1788482963.328512:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 271 00000100:00100000:2.0:1788482963.328526:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:9955:x1875360063969920:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788482963.330795:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:9955:x1875360063969920:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 2259us (8151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482963.330812:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 271 00000100:00100000:3.0:1788482963.334483:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482963.334595:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063970048 00000100:00100000:1.0:1788482963.334609:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063970048 00000100:00100000:1.0:1788482963.334684:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 272 00000100:00100000:1.0:1788482963.334697:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:9955:x1875360063970048:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788482963.335029:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:9955:x1875360063970048:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 334us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482963.335050:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 272 00000100:00100000:3.0:1788482963.341387:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482963.341787:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063970176 00000100:00100000:2.0:1788482963.341802:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063970176 00000100:00100000:2.0:1788482963.341950:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 273 00000100:00100000:2.0:1788482963.341963:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:5595:x1875360063970176:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788482963.341992:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482963.342015:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f780800/0x42820277aad78da6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779e4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482963.342046:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f780800/0x42820277aad78da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779e4 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482963.342057:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f780800/0x42820277aad78da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779e4 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482963.342066:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780800, rc 0) 00000100:00100000:2.0:1788482963.342131:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063970176:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 171us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482963.342138:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 273 00000100:00100000:3.0:1788482963.370172:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482963.371092:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063970304 00000100:00100000:0.0:1788482963.371108:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063970304 00000100:00100000:0.0:1788482963.371170:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 274 00000100:00100000:0.0:1788482963.371183:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063970304:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788482963.371679:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063970304:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 494us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482963.371689:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 274 00000100:00100000:3.0:1788482963.382313:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482963.383793:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063970432 00000100:00100000:2.0:1788482963.383812:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063970432 00000100:00100000:2.0:1788482963.383900:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 275 00000100:00100000:2.0:1788482963.383928:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063970432:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788482963.384180:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:5595:x1875360063970432:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 253us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482963.384189:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 275 00000100:00100000:3.0:1788482963.390712:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482963.390930:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063970560 00000100:00100000:1.0:1788482963.390951:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063970560 00000100:00100000:1.0:1788482963.391048:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 276 00000100:00100000:1.0:1788482963.391062:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:9958:x1875360063970560:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788482963.391441:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:9958:x1875360063970560:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 382us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482963.391450:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 276 00000100:00100000:3.0:1788482963.399817:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482963.399956:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063970688 00000100:00100000:0.0:1788482963.399975:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063970688 00000100:00100000:0.0:1788482963.400060:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 277 00000100:00100000:0.0:1788482963.400072:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:9958:x1875360063970688:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788482963.400722:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:9958:x1875360063970688:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 650us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482963.400731:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 277 00000040:00080000:3.0:1788482964.147006:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788482964.339457:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482965.364602:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482965.430286:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072395392:0@lo:400:kworker.0 00000100:00100000:0.0:1788482965.430360:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072395008:0@lo:400:kworker.0 00000100:00100000:1.0:1788482965.430439:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072395264:0@lo:400:kworker.0 00000100:00100000:3.0:1788482965.430527:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072395136:0@lo:400:kworker.0 00000100:00100000:2.0:1788482965.438762:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482965.438916:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072395392 00000100:00100000:2.0:1788482965.438927:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072395392 00000100:00100000:2.0:1788482965.439001:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788482965.439013:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072395392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482965.439096:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072395392:12345-0@lo:400:kworker.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482965.439103:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788482965.439144:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072395392:0@lo:400:kworker.0 00000100:00080000:2.0:1788482965.439174:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482965.442117:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482965.443989:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072395264 00000100:00100000:2.0:1788482965.444006:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072395264 00000100:00100000:2.0:1788482965.444096:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788482965.444115:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072395264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482965.444242:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072395264:12345-0@lo:400:kworker.0 Request processed in 134us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482965.444292:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788482965.444318:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482965.448195:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072395264:0@lo:400:kworker.0 00000100:00100000:0.0:1788482965.450612:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482965.450728:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072395520:0@lo:400:kworker.0 00000100:00100000:0.0:1788482965.450800:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482965.451512:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072395520 00000100:00100000:1.0:1788482965.451524:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072395520 00000100:00100000:1.0:1788482965.451634:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788482965.451649:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072395520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482965.451732:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072395520:12345-0@lo:400:kworker.0 Request processed in 87us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482965.451740:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788482965.453757:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482965.453764:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072395008 00000100:00100000:2.0:1788482965.453779:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072395008 00000100:00100000:0.0:1788482965.453826:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072395520:0@lo:400:kworker.0 00000100:00100000:2.0:1788482965.453839:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788482965.453870:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482965.453976:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072395008:12345-0@lo:400:kworker.0 Request processed in 107us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482965.453984:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788482965.454337:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072395008:0@lo:400:kworker.0 00000100:00100000:3.0:1788482965.454404:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482965.454447:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072395648:0@lo:400:kworker.0 00000100:00100000:3.0:1788482965.454483:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482965.454579:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072395648 00000100:00100000:1.0:1788482965.454585:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072395648 00000100:00100000:1.0:1788482965.454651:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788482965.454661:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072395648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482965.454709:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072395648:12345-0@lo:400:kworker.0 Request processed in 51us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482965.454716:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788482965.454727:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788482965.455396:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb920896300 x1875360072395648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482965.455411:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072395648:0@lo:400:kworker.0 00000100:00100000:2.0:1788482965.455651:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072395136 00000100:00100000:2.0:1788482965.455658:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072395136 00000100:00100000:2.0:1788482965.455702:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788482965.455710:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072395136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482965.455775:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072395136:12345-0@lo:400:kworker.0 Request processed in 66us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482965.455782:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788482965.456794:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072395136:0@lo:400:kworker.0 00000100:00100000:2.0:1788482965.938803:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482965.938834:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072395776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482965.938924:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482965.939086:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072395776 00000100:00100000:3.0:1788482965.939098:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072395776 00000100:00100000:3.0:1788482965.939177:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788482965.939191:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072395776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788482965.939246:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482965.939351:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072395776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482965.939359:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788482965.939450:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb908701880 x1875360072395776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482965.939472:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072395776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482966.387479:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788482966.549160:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1788482966.962900:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788482966.962965:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072395904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482966.963115:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482966.964153:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072395904 00000100:00100000:3.0:1788482966.964176:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072395904 00000100:00100000:3.0:1788482966.964324:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788482966.964337:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072395904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788482966.964393:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482966.964510:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072395904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482966.964518:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788482966.965708:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788482966.965725:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb937056300, transno 4294967300 00000100:00100000:1.0:1788482966.965778:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072395904:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482967.412650:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482968.031129:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482968.031186:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482968.031388:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063970816 00000100:00100000:1.0:1788482968.031402:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063970816 00000100:00100000:1.0:1788482968.031482:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 279 00000100:00100000:1.0:1788482968.031495:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063970816:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482968.031758:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482968.031812:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482968.031844:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063970944 00000100:00100000:3.0:1788482968.031849:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063970944 00000100:00100000:3.0:1788482968.031911:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063971200 00000100:00100000:3.0:1788482968.031914:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063971200 00000100:00100000:3.0:1788482968.031947:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:3.0:1788482968.031956:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063970944:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482968.032052:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063970944:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482968.032063:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:3.0:1788482968.032169:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:3.0:1788482968.032176:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063971200:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482968.032204:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063971200:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482968.032211:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00080000:3.0:1788482968.032235:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482968.032732:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063970816:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 1235us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482968.032743:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 279 00000100:00100000:2.0:1788482968.036368:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063971072 00000100:00100000:2.0:1788482968.036391:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063971072 00000100:00100000:2.0:1788482968.036527:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:2.0:1788482968.036542:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063971072:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:3.0:1788482968.037771:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482968.038172:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063971072:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 1619us (6970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482968.038192:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00010000:00010000:0.0:1788482968.434718:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482969.462779:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482970.482549:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482970.546669:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072396160:0@lo:400:kworker.0 00000100:00100000:0.0:1788482970.546728:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072396288:0@lo:400:kworker.0 00000100:00100000:2.0:1788482970.546747:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072396416:0@lo:400:kworker.0 00000100:00100000:0.0:1788482970.546801:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482970.546812:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482970.546837:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072396288 00000100:00100000:3.0:1788482970.546848:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072396288 00000100:00100000:1.0:1788482970.546892:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072396032:0@lo:400:kworker.0 00000100:00100000:3.0:1788482970.546936:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788482970.546949:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072396288:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788482970.556370:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482970.556413:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072396416 00000100:00100000:2.0:1788482970.556431:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072396416 00000100:00100000:2.0:1788482970.556576:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788482970.556589:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072396416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482970.566160:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072396416:12345-0@lo:400:kworker.0 Request processed in 9555us (19331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482970.566452:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788482970.566631:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482970.566705:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072396416:0@lo:400:kworker.0 00000100:00100000:2.0:1788482970.566929:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482970.567033:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072396672:0@lo:400:kworker.0 00000100:00100000:2.0:1788482970.567166:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482970.567518:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072396672 00000100:00100000:2.0:1788482970.567602:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072396160 00000100:00100000:2.0:1788482970.567612:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072396160 00000100:00100000:2.0:1788482970.567671:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788482970.567685:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072396160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482970.567767:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072396160:12345-0@lo:400:kworker.0 Request processed in 85us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482970.567769:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072396672 00000100:00100000:2.0:1788482970.567778:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788482970.567828:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072396160:0@lo:400:kworker.0 00000100:00100000:0.0:1788482970.567833:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788482970.567845:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072396672:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788482970.567879:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788482970.567900:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072396672:12345-0@lo:400:kworker.0 Request processed in 57us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482970.567908:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788482970.567910:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93a142300 x1875360072396672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482970.567925:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072396672:0@lo:400:kworker.0 00000100:00100000:1.0:1788482970.568904:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482970.568970:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072396544:0@lo:400:kworker.0 00000100:00100000:1.0:1788482970.569034:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482970.569071:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072396544 00000100:00100000:1.0:1788482970.569079:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072396544 00000100:00100000:1.0:1788482970.569144:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788482970.569154:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072396544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482970.569204:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072396544:12345-0@lo:400:kworker.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482970.569211:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788482970.569234:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482970.569296:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072396544:0@lo:400:kworker.0 00000100:00100000:2.0:1788482970.570553:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072396032 00000100:00100000:2.0:1788482970.570573:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072396032 00000100:00100000:2.0:1788482970.570653:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788482970.570669:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072396032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482970.570935:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072396032:12345-0@lo:400:kworker.0 Request processed in 270us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482970.570945:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788482970.571677:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072396032:0@lo:400:kworker.0 00000100:00100000:3.0:1788482970.572060:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072396288:12345-0@lo:400:kworker.0 Request processed in 25109us (25256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482970.572075:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788482970.573479:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072396288:0@lo:400:kworker.0 00000100:00100000:0.0:1788482971.061799:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072396800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482971.061922:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482971.062013:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072396800 00000100:00100000:1.0:1788482971.062025:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072396800 00000100:00100000:1.0:1788482971.062089:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788482971.062101:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072396800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482971.062162:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482971.062239:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072396800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482971.062280:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788482971.063732:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb908700a80 x1875360072396800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482971.063768:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072396800:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482971.506539:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482972.082599:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072396928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482972.082703:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482972.082856:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072396928 00000100:00100000:3.0:1788482972.082867:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072396928 00000100:00100000:3.0:1788482972.082948:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788482972.082962:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072396928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788482972.083016:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482972.083073:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072396928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482972.083097:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788482972.085310:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482972.085406:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072396928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482972.530601:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482973.147458:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482973.147511:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482973.147562:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482973.147603:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482973.147656:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063971584 00000100:00100000:3.0:1788482973.147675:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063971584 00000100:00100000:3.0:1788482973.147777:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:3.0:1788482973.147794:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2353:x1875360063971584:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482973.147853:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063971456 00000100:00100000:2.0:1788482973.147860:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063971456 00000100:00100000:2.0:1788482973.147906:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063971712 00000100:00100000:2.0:1788482973.147910:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063971712 00000100:00100000:3.0:1788482973.147922:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2353:x1875360063971584:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482973.147933:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:2.0:1788482973.147943:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:2.0:1788482973.147954:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+5:2353:x1875360063971456:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482973.147997:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+5:2353:x1875360063971456:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 46us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482973.148005:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:2.0:1788482973.148024:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:2.0:1788482973.148033:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2353:x1875360063971712:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482973.148061:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2353:x1875360063971712:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482973.148067:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:1.0:1788482973.148857:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063971328 00000100:00100000:1.0:1788482973.148869:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063971328 00000100:00100000:1.0:1788482973.148933:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 281 00000100:00100000:1.0:1788482973.148948:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2353:x1875360063971328:12345-192.168.201.6@tcp:400:kworker.0 00000100:00080000:2.0:1788482973.148984:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788482973.148994:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482973.149024:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2353:x1875360063971328:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 80us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482973.149033:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 281 00010000:00010000:0.0:1788482973.556475:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788482974.387062:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788482974.579681:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482975.606407:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482975.668032:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072397056:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668138:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482975.668237:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072397568:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668336:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482975.668375:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788482975.668381:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072397184:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668407:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482975.668426:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072397696:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482975.668510:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072397440:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668552:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482975.668574:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788482975.668580:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072397312:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668604:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482975.668638:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072397568 00000100:00100000:1.0:1788482975.668649:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072397568 00000100:00100000:1.0:1788482975.668730:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072397184 00000100:00100000:1.0:1788482975.668734:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072397184 00000100:00100000:1.0:1788482975.668749:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072397312 00000100:00100000:1.0:1788482975.668751:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072397312 00000100:00100000:1.0:1788482975.668770:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788482975.668780:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072397568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668848:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072397568:12345-0@lo:400:kworker.0 Request processed in 68us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.668857:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788482975.668877:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788482975.668884:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072397184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668914:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072397184:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.668920:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788482975.668939:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788482975.668945:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072397312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.668976:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072397312:12345-0@lo:400:kworker.0 Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.668982:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788482975.669011:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072397696 00000100:00100000:1.0:1788482975.669014:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072397696 00000100:00100000:1.0:1788482975.669038:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072397440 00000100:00100000:1.0:1788482975.669041:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072397440 00000100:00100000:1.0:1788482975.669057:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788482975.669064:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.669094:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072397696:12345-0@lo:400:kworker.0 Request processed in 32us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.669099:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788482975.669110:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788482975.669116:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072397440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.669140:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072397440:12345-0@lo:400:kworker.0 Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482975.669146:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788482975.669176:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482975.669181:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788482975.669184:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482975.669224:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072397312:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.669237:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072397440:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.669304:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072397184:0@lo:400:kworker.0 00010000:00080000:1.0:1788482975.669317:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93fe52300 x1875360072397696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482975.669336:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072397696:0@lo:400:kworker.0 00000100:00100000:1.0:1788482975.669349:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072397568:0@lo:400:kworker.0 00000100:00100000:0.0:1788482975.670643:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072397056 00000100:00100000:0.0:1788482975.670662:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072397056 00000100:00100000:0.0:1788482975.670748:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788482975.670763:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072397056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482975.670879:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072397056:12345-0@lo:400:kworker.0 Request processed in 121us (2741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482975.670908:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788482975.672857:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072397056:0@lo:400:kworker.0 00000100:00100000:2.0:1788482976.179462:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482976.179499:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072397824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482976.179617:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482976.180019:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072397824 00000100:00100000:3.0:1788482976.180032:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072397824 00000100:00100000:3.0:1788482976.180107:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788482976.180120:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072397824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788482976.180182:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482976.180513:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072397824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 394us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482976.180523:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788482976.185660:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb908701180 x1875360072397824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482976.185705:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072397824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482976.627656:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482977.202622:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072397952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482977.202733:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482977.202903:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072397952 00000100:00100000:1.0:1788482977.202918:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072397952 00000100:00100000:1.0:1788482977.203019:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788482977.203033:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072397952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482977.203084:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788482977.203237:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788482977.204318:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072397952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1277us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482977.204332:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788482977.204520:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072397952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788482977.652169:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482978.269155:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482978.269295:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482978.269455:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063971968 00000100:00100000:2.0:1788482978.269472:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063971968 00000100:00100000:2.0:1788482978.269598:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:2.0:1788482978.269614:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063971968:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482978.269729:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360063971968:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 109us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482978.269739:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:1.0:1788482978.270406:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063971840 00000100:00100000:1.0:1788482978.270416:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063971840 00000100:00100000:1.0:1788482978.270475:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 283 00000100:00100000:1.0:1788482978.270485:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360063971840:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482978.270550:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360063971840:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 56us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.270559:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 283 00000100:00080000:3.0:1788482978.270747:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482978.285919:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482978.290378:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063972096 00000100:00100000:1.0:1788482978.290404:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063972096 00000100:00100000:1.0:1788482978.290533:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788482978.290549:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2350:x1875360063972096:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:1.0:1788482978.290625:0:6662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78ce2 00000100:00080000:1.0:1788482978.290660:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9eb93ff28800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788482978.290733:0:6662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788482978.291214:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+2:2350:x1875360063972096:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 666us (5314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482978.291225:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00010000:00010000:2.0:1788482978.292482:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788482978.292517:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482978.293329:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482978.293475:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063972224 00000100:00100000:0.0:1788482978.293489:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063972224 00000100:00100000:0.0:1788482978.293585:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:0.0:1788482978.293599:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063972224:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482978.293699:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063972224:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 103us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482978.293708:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00080000:2.0:1788482978.295412:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788482978.674709:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482979.704302:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482980.722922:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482980.786847:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072398464:0@lo:400:kworker.0 00000100:00100000:2.0:1788482980.786982:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482980.787103:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482980.787111:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072398336:0@lo:400:kworker.0 00000100:00100000:2.0:1788482980.787144:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482980.787193:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072398336 00000100:00100000:2.0:1788482980.787203:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072398336 00000100:00100000:2.0:1788482980.787308:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788482980.787325:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072398336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482980.787407:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072398336:12345-0@lo:400:kworker.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482980.787439:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1788482980.787471:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482980.787513:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072398336:0@lo:400:kworker.0 00000100:00100000:3.0:1788482980.787614:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072398208:0@lo:400:kworker.0 00000100:00100000:3.0:1788482980.787654:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482980.787687:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072398720:0@lo:400:kworker.0 00000100:00100000:3.0:1788482980.787727:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482980.787759:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788482980.787765:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072398080:0@lo:400:kworker.0 00000100:00100000:3.0:1788482980.787802:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482980.787832:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072398592:0@lo:400:kworker.0 00000100:00100000:3.0:1788482980.787856:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482980.787888:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072398080 00000100:00100000:3.0:1788482980.787893:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072398080 00000100:00100000:3.0:1788482980.787933:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788482980.787942:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072398080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482980.787986:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072398080:12345-0@lo:400:kworker.0 Request processed in 45us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482980.787993:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788482980.788041:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072398080:0@lo:400:kworker.0 00000100:00100000:2.0:1788482980.788504:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072398208 00000100:00100000:2.0:1788482980.788510:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072398208 00000100:00100000:2.0:1788482980.788551:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072398592 00000100:00100000:2.0:1788482980.788555:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072398592 00000100:00100000:2.0:1788482980.788583:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788482980.788590:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072398208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482980.788640:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072398208:12345-0@lo:400:kworker.0 Request processed in 50us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482980.788646:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788482980.788659:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788482980.788665:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072398592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482980.788694:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072398592:12345-0@lo:400:kworker.0 Request processed in 29us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482980.788700:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788482980.788716:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482980.788821:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072398464 00000100:00100000:1.0:1788482980.788826:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072398464 00000100:00100000:1.0:1788482980.788870:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072398720 00000100:00100000:1.0:1788482980.788873:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072398720 00000100:00100000:1.0:1788482980.788889:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788482980.788896:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072398464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482980.788958:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072398464:12345-0@lo:400:kworker.0 Request processed in 63us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482980.788964:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788482980.788982:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788482980.788988:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072398720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482980.789016:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072398720:12345-0@lo:400:kworker.0 Request processed in 29us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482980.789023:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788482980.789059:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072398464:0@lo:400:kworker.0 00000100:00100000:3.0:1788482980.789347:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a141f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072398592:0@lo:400:kworker.0 00000100:00100000:3.0:1788482980.789361:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072398208:0@lo:400:kworker.0 00010000:00080000:3.0:1788482980.789377:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93a143800 x1875360072398720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788482996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788482980.789388:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072398720:0@lo:400:kworker.0 00000100:00080000:2.0:1788482980.790055:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788482980.790074:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482981.300307:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072398848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482981.300409:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482981.300657:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072398848 00000100:00100000:1.0:1788482981.300668:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072398848 00000100:00100000:1.0:1788482981.300747:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788482981.300761:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072398848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482981.300809:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482981.300876:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072398848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482981.300903:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788482981.301004:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb908702a00 x1875360072398848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788482997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788482981.301029:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072398848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788482981.747809:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788482981.924488:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:2.0:1788482981.924500:0:6686:0:(genops.c:885:class_export_put()) final put ffff9eb93ff2b800/aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:2.0:1788482981.924531:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93ff2b800/aa30c745-265d-4a44-8753-67e411452897 for lustre-OST0000 00000020:00000080:2.0:1788482981.924582:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb93ff28800 for lustre-OST0000 00000100:00100000:1.0:1788482982.324799:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072398976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482982.324984:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482982.325477:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072398976 00000100:00100000:1.0:1788482982.325491:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072398976 00000100:00100000:1.0:1788482982.325596:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788482982.325610:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072398976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482982.325668:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482982.325736:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072398976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482982.325745:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788482982.325814:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072398976:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788482982.327537:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788482982.771997:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482983.390378:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482983.390456:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482983.390573:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063972480 00000100:00100000:2.0:1788482983.390590:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063972480 00000100:00100000:2.0:1788482983.390719:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:2.0:1788482983.390737:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063972480:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482983.390882:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+5:2354:x1875360063972480:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 150us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482983.390894:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00080000:3.0:1788482983.391330:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482983.391598:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063972352 00000100:00100000:0.0:1788482983.391608:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063972352 00000100:00100000:0.0:1788482983.391665:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 285 00000100:00100000:0.0:1788482983.391675:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063972352:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482983.391778:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063972352:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 105us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482983.391787:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 285 00000100:00100000:1.0:1788482983.402419:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482983.402829:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063972608 00000100:00100000:2.0:1788482983.402847:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063972608 00000100:00100000:2.0:1788482983.403031:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:2.0:1788482983.403048:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063972608:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482983.403844:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063972608:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 793us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482983.403856:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00080000:1.0:1788482983.408193:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788482983.794647:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788482984.628774:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788482984.818590:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482985.846649:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482985.906573:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072399232:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.906665:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482985.906731:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072399744:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.906757:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482985.906788:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788482985.906794:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072399104:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.906820:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482985.906841:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072399616:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.906861:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482985.906892:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072399232 00000100:00100000:2.0:1788482985.906900:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072399232 00000100:00100000:2.0:1788482985.906946:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072399616 00000100:00100000:2.0:1788482985.906950:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072399616 00000100:00100000:2.0:1788482985.907010:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788482985.907018:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072399232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907067:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072399232:12345-0@lo:400:kworker.0 Request processed in 49us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482985.907073:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788482985.907090:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788482985.907096:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072399616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907120:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072399616:12345-0@lo:400:kworker.0 Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482985.907125:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788482985.907171:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072399616:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907180:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072399232:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907228:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072399744 00000100:00100000:2.0:1788482985.907231:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072399744 00000100:00100000:2.0:1788482985.907294:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788482985.907300:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072399744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907331:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072399744:12345-0@lo:400:kworker.0 Request processed in 32us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482985.907337:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788482985.907352:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072399488:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907372:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482985.907389:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482985.907394:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072399360:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907413:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482985.907434:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072399360 00000100:00100000:2.0:1788482985.907443:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072399360 00000100:00100000:2.0:1788482985.907472:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788482985.907478:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072399360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907508:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072399360:12345-0@lo:400:kworker.0 Request processed in 31us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482985.907514:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788482985.907537:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072399360:0@lo:400:kworker.0 00010000:00080000:2.0:1788482985.907559:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93a143480 x1875360072399744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788483001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788482985.907569:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072399744:0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907593:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072399104 00000100:00100000:2.0:1788482985.907597:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072399104 00000100:00100000:2.0:1788482985.907621:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788482985.907629:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072399104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482985.907678:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072399104:12345-0@lo:400:kworker.0 Request processed in 51us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482985.907685:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788482985.907717:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072399104:0@lo:400:kworker.0 00000100:00080000:2.0:1788482985.907741:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788482985.907746:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482985.907926:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072399488 00000100:00100000:0.0:1788482985.907931:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072399488 00000100:00100000:0.0:1788482985.907985:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788482985.907995:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072399488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788482985.908040:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072399488:12345-0@lo:400:kworker.0 Request processed in 49us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482985.908046:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788482985.908083:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072399488:0@lo:400:kworker.0 00000100:00080000:2.0:1788482985.909678:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788482986.151398:0:11828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:49:44 (1788482984) 00000100:00100000:1.0:1788482986.422318:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072399872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788482986.422405:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482986.422506:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072399872 00000100:00100000:1.0:1788482986.422514:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072399872 00000100:00100000:1.0:1788482986.422564:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788482986.422574:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072399872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482986.422610:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482986.422651:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072399872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482986.422657:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788482986.422695:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb93f163480 x1875360072399872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788482986.422724:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072399872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788482986.866625:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482987.420863:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482987.420916:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482987.420971:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482987.421146:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063972736 00000100:00100000:3.0:1788482987.421158:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063972736 00000100:00100000:3.0:1788482987.421243:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 287 00000100:00100000:3.0:1788482987.421286:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360063972736:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482987.421385:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360063972736:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 100us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482987.421393:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 287 00000100:00100000:0.0:1788482987.423595:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063972992 00000100:00100000:0.0:1788482987.423614:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063972992 00000100:00100000:0.0:1788482987.423706:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063972864 00000100:00100000:0.0:1788482987.423710:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063972864 00000100:00100000:0.0:1788482987.423746:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:0.0:1788482987.423757:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063972992:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482987.423833:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360063972992:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 78us (2917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482987.423840:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:0.0:1788482987.423857:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:0.0:1788482987.423863:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063972864:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482987.423888:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063972864:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (2917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482987.423915:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00080000:2.0:1788482987.424076:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482987.448191:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788482987.448740:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072400000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482987.448849:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482987.449103:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072400000 00000100:00100000:1.0:1788482987.449114:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072400000 00000100:00100000:1.0:1788482987.449324:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788482987.449336:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072400000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788482987.449388:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482987.449502:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072400000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482987.449511:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788482987.449770:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072400000:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788482987.449838:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482987.767345:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482987.767419:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063973120 00000100:00100000:0.0:1788482987.767430:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063973120 00000100:00100000:0.0:1788482987.767542:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:0.0:1788482987.767564:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+5:10227:x1875360063973120:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788482987.767585:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482987.767608:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78dad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779eb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482987.767675:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78db4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482987.767689:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482987.767702:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482987.767904:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788482987.767909:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788482987.768033:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482987.768060:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78dad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779eb expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482987.768078:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78db4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779eb expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482987.768096:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:0.0:1788482987.768099:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788482987.768102:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369e00, rc 0) 00000100:00100000:0.0:1788482987.768170:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+6:10227:x1875360063973120:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 618us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482987.768178:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:1.0:1788482987.777778:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482987.777895:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063973248 00000100:00100000:2.0:1788482987.777908:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063973248 00000100:00100000:2.0:1788482987.778048:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:2.0:1788482987.778063:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+6:10228:x1875360063973248:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788482987.778085:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482987.778105:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78dbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779f2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778176:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778192:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778211:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778228:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778234:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778240:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778728:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad78dd0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778738:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad78dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778745:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad78dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482987.778829:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788482987.778833:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788482987.778914:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad78dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778926:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778933:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778940:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778957:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482987.778961:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778968:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778980:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:2.0:1788482987.778988:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482987.778993:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.778999:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78dc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779012:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779018:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779024:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779029:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482987.779032:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779037:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779043:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9eb911fa9300) 00010000:00010000:2.0:1788482987.779046:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482987.779048:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779053:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779083:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78dbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779f2 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779109:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad78dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779f2 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.779117:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eb911fa9f00) 00010000:00010000:2.0:1788482987.779119:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788482987.779121:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780000, rc 0) 00000100:00100000:2.0:1788482987.779189:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+7:10228:x1875360063973248:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1131us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482987.779197:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:3.0:1788482987.799600:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482987.799816:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063973504 00000100:00100000:2.0:1788482987.799832:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063973504 00000100:00100000:2.0:1788482987.799896:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:2.0:1788482987.799907:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+7:10228:x1875360063973504:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788482987.799940:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482987.799970:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78dd7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe70779f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.800043:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.800058:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.800068:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.802128:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.802163:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.802176:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.807789:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78dec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.807813:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78dec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.807825:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78dec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482987.807838:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788482987.812949:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.812969:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.812980:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.812986:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482987.812992:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.812999:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813035:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eb911fa9f00) 00010000:00010000:2.0:1788482987.813038:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482987.813043:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813050:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78dde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813065:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813071:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813077:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813082:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482987.813085:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813090:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813097:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eb911fa9300) 00010000:00010000:2.0:1788482987.813099:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482987.813102:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813107:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78de5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813871:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78dd7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779f9 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813891:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78dec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779f9 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482987.813900:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:2.0:1788482987.813903:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482987.813906:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781400, rc 0) 00000100:00100000:2.0:1788482987.814145:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+9:10228:x1875360063973504:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 14237us (14554us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788482987.814154:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:0.0:1788482987.818771:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482987.818871:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063973632 00000100:00100000:3.0:1788482987.818883:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063973632 00000100:00100000:3.0:1788482987.819068:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:3.0:1788482987.819081:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+9:10228:x1875360063973632:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788482987.819246:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+9:10228:x1875360063973632:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 165us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482987.819290:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00010000:00010000:0.0:1788482987.890784:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788482988.722958:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788482988.921463:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788482989.942634:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482990.490703:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482990.490810:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063973760 00000100:00100000:3.0:1788482990.490824:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063973760 00000100:00100000:3.0:1788482990.490929:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1788482990.490946:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+9:10270:x1875360063973760:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482990.490974:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482990.491002:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a00 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491088:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491133:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491147:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491166:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491174:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491180:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491561:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491570:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491577:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491583:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482990.491589:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491597:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491613:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:3.0:1788482990.491623:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482990.491629:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491637:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491654:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491660:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491666:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491672:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482990.491675:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491682:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491690:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eb9231ebe00) 00010000:00010000:3.0:1788482990.491693:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482990.491696:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491702:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491758:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78dfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a00 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491784:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:3.0:1788482990.491787:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482990.491791:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a00 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.491802:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493400, rc 0) 00000100:00100000:3.0:1788482990.491910:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+9:10270:x1875360063973760:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 968us (1224us total) trans 0 rc 301/301 00000100:00100000:3.0:1788482990.491919:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00080000:1.0:1788482990.492607:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482990.504790:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482990.504952:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063974016 00000100:00100000:1.0:1788482990.504966:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063974016 00000100:00100000:1.0:1788482990.505068:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:1.0:1788482990.505082:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+9:10270:x1875360063974016:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:1.0:1788482990.505177:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482990.505212:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78db4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779eb expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.505236:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:1.0:1788482990.505282:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788482990.505702:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.505722:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.505741:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.505756:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.505763:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.505770:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482990.515582:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788482990.515612:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.515625:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.515632:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.515637:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482990.515644:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.515654:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.515679:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:1.0:1788482990.515683:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482990.515699:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.515707:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788482990.515737:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a26b84f reply state 00000000dc7e2960 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482990.515751:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788482990.517692:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+10:10270:x1875360063974016:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 12595us (12902us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788482990.517708:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00010000:00010000:3.0:1788482990.526096:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.526117:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.526126:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.526133:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482990.526139:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.526147:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.526170:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eb9050b3100) 00010000:00010000:3.0:1788482990.526173:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482990.526179:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.526200:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad78e16 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482990.617072:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482990.617127:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063974144 00000100:00100000:3.0:1788482990.617141:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063974144 00000100:00100000:3.0:1788482990.617247:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1788482990.617292:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+9:10278:x1875360063974144:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:3.0:1788482990.617330:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482990.617364:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a07 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.617461:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.617481:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.617498:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482990.617614:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788482990.617620:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788482990.617688:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.617723:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a07 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.617767:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a07 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.617778:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788482990.617781:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788482990.617786:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493000, rc 0) 00000100:00100000:3.0:1788482990.618460:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+10:10278:x1875360063974144:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 1166us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482990.618471:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:2.0:1788482990.695494:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482990.695564:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063974272 00000100:00100000:3.0:1788482990.695579:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063974272 00000100:00100000:3.0:1788482990.695661:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:3.0:1788482990.695674:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+10:10284:x1875360063974272:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788482990.695707:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482990.695735:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a0e expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.696800:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.696840:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482990.696862:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.696986:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.696998:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697007:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697210:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697219:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697227:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482990.697526:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788482990.697531:0:6958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788482990.697603:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697620:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697627:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697635:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697642:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482990.697649:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697658:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697675:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:2.0:1788482990.697679:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482990.697685:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697691:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad78e32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697711:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697731:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697737:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697742:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482990.697746:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697752:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697761:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9eb911fa9300) 00010000:00010000:2.0:1788482990.697764:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482990.697768:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697775:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad78e39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697974:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad78e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a0e expref: 12 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.697996:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78e40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a0e expref: 11 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.698005:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:2.0:1788482990.698007:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788482990.698016:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781c00, rc 0) 00000100:00100000:2.0:1788482990.698770:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+11:10284:x1875360063974272:12345-192.168.201.6@tcp:101:bash.0 Request processed in 3087us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482990.698785:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:3.0:1788482990.701434:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482990.701623:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063974528 00000100:00100000:0.0:1788482990.701636:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063974528 00000100:00100000:0.0:1788482990.701707:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:0.0:1788482990.701719:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+11:10284:x1875360063974528:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788482990.701748:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482990.701777:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78e47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a15 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482990.701967:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482990.701984:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482990.701997:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482990.702168:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482990.702329:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482990.702344:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788482990.705817:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788482990.707347:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707369:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707383:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707430:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707437:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707445:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707451:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482990.707468:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707477:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707491:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:1.0:1788482990.707495:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482990.707500:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707507:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78e4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788482990.707524:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3e90e6e reply state 000000003b781146 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482990.707533:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788482990.707574:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78e47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707590:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.707598:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:1.0:1788482990.707601:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788482990.707604:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627a00, rc 0) 00000100:00100000:1.0:1788482990.707827:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+14:10284:x1875360063974528:12345-192.168.201.6@tcp:101:bash.0 Request processed in 6108us (6407us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788482990.707837:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:3.0:1788482990.714177:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482990.714439:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063974656 00000100:00100000:0.0:1788482990.714456:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063974656 00000100:00100000:0.0:1788482990.714535:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:0.0:1788482990.714547:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875360063974656:12345-192.168.201.6@tcp:8:bash.0 00010000:00080000:0.0:1788482990.714594:0:6660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp t0 exp 0000000000000000 cur 307 last 0 00010000:00010000:1.0:1788482990.714606:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.714628:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788482990.714638:0:6660:0:(genops.c:1385:class_connect()) connect: client aa30c745-265d-4a44-8753-67e411452897, cookie 0x42820277aad78e6a 00010000:00010000:1.0:1788482990.714640:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1788482990.714657:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa30c745-265d-4a44-8753-67e411452897/ffff9eb936e2d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00010000:00010000:1.0:1788482990.714663:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482990.714673:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.714684:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1788482990.714690:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00010000:00010000:1.0:1788482990.714706:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb907174e00) 00010000:00010000:1.0:1788482990.714712:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482990.714718:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.714724:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad78e55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788482990.715024:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788482990.715076:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb936e2e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788482990.715168:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2350:x1875360063974656:12345-192.168.201.6@tcp:8:bash.0 Request processed in 622us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482990.715179:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:2.0:1788482990.717529:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482990.717645:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063974784 00000100:00100000:0.0:1788482990.717662:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063974784 00000100:00080000:1.0:1788482990.717745:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788482990.717747:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:0.0:1788482990.717767:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+6:0:x1875360063974784:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788482990.717788:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482990.717826:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a1c expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788482990.717875:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788482990.717903:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788482990.717908:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482990.717918:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 7 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482990.718217:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 7 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482990.718234:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368e00, rc 0) 00000100:00100000:0.0:1788482990.718489:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:0:x1875360063974784:12345-192.168.201.6@tcp:101:bash.0 Request processed in 725us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482990.718498:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1788482990.729767:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482990.729885:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063974912 00000100:00100000:2.0:1788482990.729918:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063974912 00000100:00100000:2.0:1788482990.730015:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1788482990.730028:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:10284:x1875360063974912:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788482990.730052:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482990.730081:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a23 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.730124:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 8 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.730134:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788482990.730139:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788482990.730145:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.730193:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 8 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.730208:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 8 pid: 6662 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482990.730316:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6663:1875360072400128:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482990.730469:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9243c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482990.733381:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6663:1875360072400128:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788482990.733439:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482990.733467:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780c00, rc 0) 00000100:00100000:3.0:1788482990.733483:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482990.733565:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063975040 00000100:00100000:1.0:1788482990.733574:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063975040 00010000:00010000:1.0:1788482990.733621:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 9 pid: 6662 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482990.733665:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1788482990.733675:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+9:2351:x1875360063975040:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788482990.733714:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482990.733765:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 9 pid: 6662 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.733780:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 9 pid: 6662 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.733810:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad78e71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a1c expref: 9 pid: 6662 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.733828:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482990.733833:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482990.733843:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.733856:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.733910:0:8490:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482990.733927:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f161f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8490:1875360072400256:192.168.201.6@tcp:105: 00000100:00100000:1.0:1788482990.734043:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b0343c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482990.734386:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+8:10284:x1875360063974912:12345-192.168.201.6@tcp:101:bash.0 Request processed in 4359us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482990.734395:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1788482990.742483:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f161f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8490:1875360072400256:192.168.201.6@tcp:105: 00010000:00010000:1.0:1788482990.742524:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482990.742634:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360063975040:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 8958us (9161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482990.742648:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:3.0:1788482990.753796:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482990.753959:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063975296 00000100:00100000:1.0:1788482990.753979:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063975296 00000100:00100000:1.0:1788482990.754083:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788482990.754100:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+13:10284:x1875360063975296:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:1.0:1788482990.754831:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+14:10284:x1875360063975296:12345-192.168.201.6@tcp:35:bash.0 Request processed in 731us (1042us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788482990.754841:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1788482990.876366:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482990.876489:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063975552 00000100:00100000:1.0:1788482990.876513:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063975552 00000100:00100000:1.0:1788482990.876684:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:1.0:1788482990.876705:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+14:10294:x1875360063975552:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788482990.876762:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482990.876799:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78e7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a2a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482990.878108:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788482990.878438:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78e7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a2a expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.878461:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:1.0:1788482990.878464:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788482990.878470:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a2a expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482990.878520:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626400, rc 0) 00000100:00100000:1.0:1788482990.878634:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+15:10294:x1875360063975552:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1936us (2279us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788482990.878644:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:0.0:1788482990.888605:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482990.888731:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063975808 00000100:00100000:1.0:1788482990.888749:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063975808 00000100:00100000:1.0:1788482990.888837:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788482990.888852:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+15:10294:x1875360063975808:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482990.889696:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+16:10294:x1875360063975808:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 840us (1104us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788482990.889709:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00010000:00010000:0.0:1788482990.963605:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482991.024870:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482991.025127:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063975936 00000100:00100000:1.0:1788482991.025142:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063975936 00000100:00100000:1.0:1788482991.025222:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:1.0:1788482991.025237:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+16:10300:x1875360063975936:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788482991.025567:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482991.025601:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.026076:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78e94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.026097:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.026114:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482991.026225:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788482991.026230:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482991.027942:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.028604:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a31 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.028633:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78e94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a31 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.028644:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00000100:00100000:0.0:1788482991.028951:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072400640:0@lo:400:kworker.0 00000100:00100000:0.0:1788482991.029268:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788482991.029396:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788482991.029403:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627400, rc 0) 00000100:00100000:2.0:1788482991.029569:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072400384:0@lo:400:kworker.0 00000100:00100000:2.0:1788482991.029614:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482991.029796:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072400896:0@lo:400:kworker.0 00000100:00100000:2.0:1788482991.029822:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482991.029850:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788482991.029855:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072400512:0@lo:400:kworker.0 00000100:00100000:2.0:1788482991.029874:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482991.029908:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072401024:0@lo:400:kworker.0 00000100:00100000:2.0:1788482991.029937:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482991.030061:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+17:10300:x1875360063975936:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 4824us (5204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482991.030073:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:1.0:1788482991.030108:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072400640 00000100:00100000:1.0:1788482991.030128:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072400640 00000100:00100000:1.0:1788482991.030177:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072400896 00000100:00100000:1.0:1788482991.030181:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072400896 00000100:00100000:1.0:1788482991.030196:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072400512 00000100:00100000:1.0:1788482991.030198:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072400512 00000100:00100000:1.0:1788482991.030212:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788482991.030221:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072400640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482991.030342:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072400640:12345-0@lo:400:kworker.0 Request processed in 120us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482991.030349:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788482991.030371:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788482991.030378:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072400896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482991.030406:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072400896:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482991.030413:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788482991.030422:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788482991.030427:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072400512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482991.030447:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072400512:12345-0@lo:400:kworker.0 Request processed in 20us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482991.030578:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072400640:0@lo:400:kworker.0 00000100:00100000:0.0:1788482991.030606:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788482991.030613:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788482991.030642:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482991.030806:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072400384 00000100:00100000:3.0:1788482991.030811:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072400384 00000100:00100000:3.0:1788482991.030846:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788482991.030853:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072400384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482991.030902:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072400384:12345-0@lo:400:kworker.0 Request processed in 50us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.030909:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788482991.031184:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072400512:0@lo:400:kworker.0 00000100:00100000:2.0:1788482991.031196:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072400384:0@lo:400:kworker.0 00000100:00100000:2.0:1788482991.031208:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072400896:0@lo:400:kworker.0 00000100:00080000:2.0:1788482991.031476:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482991.031575:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788482991.038220:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072401024 00000100:00100000:3.0:1788482991.038278:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072401024 00000100:00100000:3.0:1788482991.038395:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072400768 00000100:00100000:3.0:1788482991.038400:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072400768 00000100:00100000:3.0:1788482991.038434:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788482991.038447:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072401024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482991.040410:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072401024:12345-0@lo:400:kworker.0 Request processed in 1962us (10468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.040425:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788482991.040486:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788482991.040501:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072400768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788482991.040554:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072400768:12345-0@lo:400:kworker.0 Request processed in 60us (9912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.040560:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788482991.041603:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482991.041614:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788482991.041734:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072400768:0@lo:400:kworker.0 00000100:00100000:3.0:1788482991.052434:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072401024:0@lo:400:kworker.0 00000100:00100000:2.0:1788482991.059023:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482991.059367:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063976192 00000100:00100000:3.0:1788482991.059384:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063976192 00000100:00100000:3.0:1788482991.060707:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:3.0:1788482991.060749:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+17:10300:x1875360063976192:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482991.060789:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482991.060828:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78e9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a38 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.061008:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78ea2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.061027:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.061043:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482991.061058:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788482991.061282:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78e9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a38 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.061308:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a38 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.061320:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:3.0:1788482991.061324:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788482991.061329:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492e00, rc 0) 00000100:00100000:3.0:1788482991.061419:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+19:10300:x1875360063976192:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 686us (2415us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788482991.061449:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1788482991.067135:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482991.067396:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063976448 00000100:00100000:3.0:1788482991.067411:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063976448 00000100:00100000:3.0:1788482991.067545:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:3.0:1788482991.067559:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+19:10300:x1875360063976448:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482991.067591:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482991.067617:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78eb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a3f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.069018:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78eb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.069075:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.069090:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482991.069112:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788482991.069338:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78eb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a3f expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.069366:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a3f expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.069376:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:0.0:1788482991.069379:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788482991.069383:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368400, rc 0) 00000100:00100000:0.0:1788482991.069490:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+21:10300:x1875360063976448:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1931us (2369us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788482991.069502:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:3.0:1788482991.070337:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482991.074393:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063976576 00000100:00100000:2.0:1788482991.074419:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063976576 00000100:00100000:2.0:1788482991.074544:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1788482991.074559:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+21:2353:x1875360063976576:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788482991.074583:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482991.074621:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78ea2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a38 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.074668:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:2.0:1788482991.074675:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482991.074774:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+20:2353:x1875360063976576:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 218us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482991.074784:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1788482991.083982:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482991.084150:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063976704 00000100:00100000:3.0:1788482991.084163:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063976704 00000100:00100000:3.0:1788482991.084225:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1788482991.084236:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360063976704:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:3.0:1788482991.084324:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.084349:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.084358:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788482991.084362:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788482991.084367:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.084407:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.084438:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 7 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482991.084455:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921645180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6662:1875360072401152:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482991.084550:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fe480 going to sleep for 11 seconds 00000100:00100000:3.0:1788482991.089751:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921645180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6662:1875360072401152:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788482991.089788:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482991.095220:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482991.095408:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063976832 00000100:00100000:2.0:1788482991.095420:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063976832 00002000:00100000:2.0:1788482991.095475:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9eb93ff52d80 x1875360063976832/t0(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:497/0 lens 504/0 e 0 to 0 dl 1788483002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788482991.095487:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb93ff52d80 with x1875360063976832 ext(0->12) 00010000:00010000:2.0:1788482991.095497:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 8 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.095516:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 8 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788482991.095543:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eb93ff52d80 00000100:00100000:2.0:1788482991.095570:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788482991.095581:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360063976832:12345-192.168.201.6@tcp:4:lfs.0 00000001:00100000:2.0:1788482991.200499:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000100:00100000:1.0:1788482991.201409:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360063976832:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 105819us (106193us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788482991.201426:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00002000:00100000:1.0:1788482991.201440:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9eb93ff52d80 x1875360063976832/t4294967299(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:497/0 lens 504/448 e 0 to 0 dl 1788483002 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788482991.201451:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb93ff52d80 with x1875360063976832 ext(0->12) 00010000:00010000:1.0:1788482991.201462:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 9 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.201482:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 9 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788482991.201491:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eb93ff52d80 00000100:00100000:0.0:1788482991.208396:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482991.210155:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063976960 00000100:00100000:1.0:1788482991.210172:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063976960 00010000:00010000:1.0:1788482991.210237:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 9 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482991.210326:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:1.0:1788482991.210338:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+9:2353:x1875360063976960:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788482991.210355:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788482991.210382:0:5794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788482991.210386:0:5794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788482990 00002000:00010000:1.0:1788482991.210388:0:5794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788482991 00002000:00010000:1.0:1788482991.210391:0:5794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788482990 00010000:00010000:1.0:1788482991.210397:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 9 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.210413:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 9 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.210435:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cb46fb/0x42820277aad78e78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a23 expref: 9 pid: 6663 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.210452:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788482991.210457:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788482991.210463:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.210473:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.210536:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482991.210612:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+8:2353:x1875360063976960:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 276us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482991.210621:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00010000:00010000:3.0:1788482991.211765:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.211785:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.211824:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.211832:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.211842:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.211873:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788482991.211880:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.211900:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.211925:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.211933:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad78ec5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482991.212193:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360063976704:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 127953us (128220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.212206:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1788482991.220403:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482991.220717:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063977216 00000100:00100000:2.0:1788482991.220730:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063977216 00000100:00100000:3.0:1788482991.224210:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788482991.224224:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+20:10300:x1875360063977216:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:3.0:1788482991.224346:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a3f expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788482991.224639:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788482991.224676:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788482991.225512:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788482991.225580:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.225603:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.225612:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.225650:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.225667:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 24 pid: 5806 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482991.225682:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921645180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1875360072401280:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482991.226358:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90854a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788482991.229772:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482991.229901:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063977344 00000100:00100000:0.0:1788482991.229911:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063977344 00010000:00010000:0.0:1788482991.229955:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 25 pid: 5806 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482991.230011:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:0.0:1788482991.230038:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+25:2351:x1875360063977344:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482991.230053:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482991.230062:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 25 pid: 5806 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.230076:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 25 pid: 5806 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.230101:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:0.0:1788482991.230107:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.230291:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.230300:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.230324:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482991.230409:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+25:2351:x1875360063977344:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 372us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482991.230418:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00010000:00010000:1.0:1788482991.231327:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78e5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a15 expref: 24 pid: 5806 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482991.231351:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921645180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1875360072401280:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482991.231383:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.231393:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.231399:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788482991.231538:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788482991.231789:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788482991.232047:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f161f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1875360072401408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788482991.232123:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482991.232228:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb92e957240 going to sleep for 11 seconds 00000100:00100000:2.0:1788482991.232517:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072401408 00000100:00100000:2.0:1788482991.232525:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072401408 00000100:00100000:2.0:1788482991.232604:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788482991.232614:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875360072401408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788482991.232703:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875360072401408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482991.232710:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788482991.232789:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f161f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1875360072401408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788482991.233575:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788482991.233650:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921647800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1875360072401536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788482991.233699:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482991.234328:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90854aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788482991.234414:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072401536 00000100:00100000:1.0:1788482991.234423:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072401536 00000100:00100000:1.0:1788482991.234464:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788482991.234474:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5811:x1875360072401536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788482991.234772:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875360072401536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 298us (1072us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788482991.234792:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788482991.235189:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921647800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1875360072401536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788482991.235380:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788482991.235432:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.235444:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.235460:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.235466:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482991.235470:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.235479:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.235499:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:3.0:1788482991.235502:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788482991.235507:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.235512:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ecc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788482991.235715:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788482991.236530:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788482991.236547:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308402296728ns, next at 309402293700ns, rc = 0 00000001:00080000:3.0:1788482991.236559:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788482991.236605:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3a00) 00010000:00010000:3.0:1788482991.236609:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788482991.236617:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78eb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a3f expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482991.236786:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+27:10300:x1875360063977216:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 12564us (16395us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788482991.236811:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000020:00080000:3.0:1788482991.236829:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788482991.242899:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482991.244148:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063977472 00000100:00100000:0.0:1788482991.244163:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063977472 00000100:00100000:0.0:1788482991.244243:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:0.0:1788482991.244427:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+27:10300:x1875360063977472:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788482991.244453:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482991.244479:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78ed3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a46 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.244691:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a46 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.244705:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a46 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.244723:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788482991.244726:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788482991.244730:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368e00, rc 0) 00000100:00100000:0.0:1788482991.244846:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+28:10300:x1875360063977472:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 559us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482991.244853:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:0.0:1788482991.260677:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482991.265181:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063977728 00000100:00100000:2.0:1788482991.265200:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063977728 00000100:00100000:2.0:1788482991.265442:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788482991.265455:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb91888a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+28:10300:x1875360063977728:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788482991.266948:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb91888a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+29:10300:x1875360063977728:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 1471us (6259us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788482991.266974:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788482991.406459:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482991.406657:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063977984 00000100:00100000:1.0:1788482991.406673:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063977984 00000100:00100000:1.0:1788482991.406751:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:1.0:1788482991.406763:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+29:10310:x1875360063977984:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788482991.406797:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482991.406833:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78eda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a4d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482991.406980:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788482991.407163:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78eda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a4d expref: 31 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.407182:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:1.0:1788482991.407184:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788482991.407190:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a4d expref: 31 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.407206:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627a00, rc 0) 00000100:00100000:1.0:1788482991.407409:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+30:10310:x1875360063977984:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 647us (962us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788482991.407416:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1788482991.413444:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482991.413558:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063978112 00000100:00100000:3.0:1788482991.413569:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063978112 00000100:00100000:3.0:1788482991.413673:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:3.0:1788482991.413684:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+30:10310:x1875360063978112:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1788482991.413772:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.413790:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.413801:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.413827:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.413836:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.413843:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.413964:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.413973:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.413994:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788482991.414039:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414052:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414057:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414063:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414069:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482991.414073:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414079:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414091:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482991.414094:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482991.414099:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414234:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78ee8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414280:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414294:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414299:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414304:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482991.414307:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414313:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414321:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9231eb500) 00010000:00010000:3.0:1788482991.414324:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482991.414326:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414332:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78eef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414356:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414363:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414368:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414373:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482991.414383:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414389:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414398:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482991.414400:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482991.414403:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.414410:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78ef6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482991.414535:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+30:10310:x1875360063978112:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 851us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482991.414544:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:3.0:1788482991.425064:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482991.425335:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063978368 00000100:00100000:1.0:1788482991.425346:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063978368 00000100:00100000:1.0:1788482991.425416:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1788482991.425427:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+30:10310:x1875360063978368:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482991.425806:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+31:10310:x1875360063978368:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 379us (753us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788482991.425816:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788482991.477456:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482991.477555:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063978624 00000100:00100000:1.0:1788482991.477568:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063978624 00000100:00100000:1.0:1788482991.477636:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:1.0:1788482991.477646:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+31:10313:x1875360063978624:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788482991.477674:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482991.477694:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78efd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a54 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.477783:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.477798:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.477810:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.477824:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.477830:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.477836:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.477991:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478017:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478023:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482991.478034:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788482991.478148:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478156:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478162:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478168:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482991.478173:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478180:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478192:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:1.0:1788482991.478195:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482991.478200:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478206:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad78f04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478219:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478231:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478237:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478243:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482991.478309:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478318:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478328:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9050b3000) 00010000:00010000:1.0:1788482991.478331:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482991.478334:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478340:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478388:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78efd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478402:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.478409:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788482991.478412:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788482991.478421:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626c00, rc 0) 00000100:00100000:1.0:1788482991.478493:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+33:10313:x1875360063978624:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 847us (1048us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788482991.478501:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:0.0:1788482991.485952:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482991.486075:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063978752 00000100:00100000:2.0:1788482991.486086:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063978752 00000100:00100000:2.0:1788482991.486159:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1788482991.486171:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+33:10313:x1875360063978752:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1788482991.486332:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486355:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486367:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486398:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486406:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486413:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486419:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482991.486425:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486433:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486447:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788482991.486451:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788482991.486455:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.486462:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482991.486550:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+33:10313:x1875360063978752:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 380us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482991.486559:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:3.0:1788482991.489690:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482991.490504:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063979008 00000100:00100000:1.0:1788482991.490515:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063979008 00000100:00100000:1.0:1788482991.490604:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788482991.490615:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+33:10313:x1875360063979008:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482991.491044:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+34:10313:x1875360063979008:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 430us (1365us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788482991.491052:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1788482991.538745:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788482991.538769:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072401664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482991.538858:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482991.539132:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072401664 00000100:00100000:1.0:1788482991.539142:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072401664 00000100:00100000:1.0:1788482991.539212:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788482991.539223:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072401664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482991.539282:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482991.539333:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072401664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482991.539340:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788482991.539470:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072401664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788482991.793074:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482991.793406:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063979264 00000100:00100000:1.0:1788482991.793418:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063979264 00000100:00100000:1.0:1788482991.793499:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:1.0:1788482991.793511:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+34:10344:x1875360063979264:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:1.0:1788482991.793542:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482991.793570:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78f27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a5b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.793749:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.793769:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.793783:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482991.793797:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788482991.794088:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad78f27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a5b expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.794532:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a5b expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482991.794542:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788482991.794545:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788482991.794549:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626600, rc 0) 00000100:00100000:1.0:1788482991.794666:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+36:10344:x1875360063979264:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1155us (1605us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788482991.794675:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1788482991.801343:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482991.801444:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063979520 00000100:00100000:2.0:1788482991.801455:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063979520 00000100:00100000:2.0:1788482991.801528:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1788482991.801540:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+36:10344:x1875360063979520:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:2.0:1788482991.801880:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+37:10344:x1875360063979520:12345-192.168.201.6@tcp:35:cat.0 Request processed in 335us (541us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788482991.801889:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1788482991.812019:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482991.812310:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063979648 00000100:00100000:0.0:1788482991.812321:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063979648 00000100:00100000:0.0:1788482991.812396:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:0.0:1788482991.812407:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+37:2351:x1875360063979648:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482991.812422:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482991.812448:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad78f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a5b expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.812492:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788482991.812497:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482991.812568:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+36:2351:x1875360063979648:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 163us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482991.812575:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:0.0:1788482991.892400:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482991.892508:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063979904 00000100:00100000:2.0:1788482991.892519:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063979904 00000100:00100000:2.0:1788482991.892587:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:2.0:1788482991.892599:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+36:10350:x1875360063979904:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:2.0:1788482991.892628:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482991.892631:0:6958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788482991.892663:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad78e94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a31 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.892684:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:2.0:1788482991.892689:0:6958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788482991.892720:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a62 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.892861:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.892889:0:6958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.892898:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.892934:0:6958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.892949:0:6958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 36 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482991.892964:0:6958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92e95b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072401792:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482991.893089:0:6958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93723dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788482991.896793:0:6958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92e95b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072401792:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788482991.896845:0:6958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482991.899818:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482991.899949:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063980032 00000100:00100000:2.0:1788482991.899963:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063980032 00010000:00010000:2.0:1788482991.900022:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 37 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482991.900078:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:2.0:1788482991.900115:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+37:2352:x1875360063980032:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788482991.900134:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482991.900142:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 37 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.900171:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 37 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.900199:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad78f12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a54 expref: 37 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.900220:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788482991.900227:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.900239:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.900301:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482991.900334:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482991.900393:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+36:2352:x1875360063980032:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 280us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482991.900401:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00010000:00010000:3.0:1788482991.901090:0:6958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.901111:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482991.901141:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788482991.901716:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad78f3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 37 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.901745:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 36 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.901776:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482991.901780:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788482991.901783:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781a00, rc 0) 00000100:00100000:3.0:1788482991.901852:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+36:10350:x1875360063979904:12345-192.168.201.6@tcp:101:dd.0 Request processed in 9255us (9466us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788482991.901861:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1788482991.907003:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482991.907205:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063980288 00000100:00100000:0.0:1788482991.907220:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063980288 00000100:00100000:0.0:1788482991.907336:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1788482991.907348:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+36:10350:x1875360063980288:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:0.0:1788482991.907950:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.907980:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.907995:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788482991.908062:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788482991.908172:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e244995 reply state 00000000fd049349 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482991.908185:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788482991.908359:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+39:10350:x1875360063980288:12345-192.168.201.6@tcp:36:dd.0 Request processed in 1010us (1365us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788482991.908366:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000020:00080000:0.0:1788482991.908382:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788482991.911607:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.911629:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.911637:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.911643:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482991.911647:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.911654:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.911673:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482991.911676:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482991.911681:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482991.911687:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad78f51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482991.986591:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788482992.171060:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:0.0:1788482992.171143:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788482992.171173:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eb90854ae40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788482992.171179:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb93f7a7e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eb90854a780 00000020:00080000:0.0:1788482992.171182:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb93f7a7800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eb937cfe000 00000020:00080000:0.0:1788482992.171213:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788482992.171387:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788482992.171751:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072401920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788482992.171835:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482992.172172:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072401920 00000100:00100000:1.0:1788482992.172185:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072401920 00000100:00100000:1.0:1788482992.172291:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788482992.172303:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072401920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788482992.172335:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788482992.172406:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9a15ae, atime: 0x6a9a15af, ctime: 0x6a9a15ae, blocks: 0x1 00010000:00010000:1.0:1788482992.172415:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.172433:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:1.0:1788482992.172437:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482992.172444:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.172475:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.172487:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.172494:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.172517:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788482992.173377:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3278:x1875360072401920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1072us (1539us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788482992.173386:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1788482992.174208:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb93f163100/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788482992.174220:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072401920:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788482992.174582:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788482992.174667:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.174683:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788482992.174689:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.174700:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.174728:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.174761:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad78f58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.174791:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482992.174793:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788482992.174795:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788482992.209459:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482992.209790:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063980416 00000100:00100000:0.0:1788482992.209876:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063980416 00000100:00100000:0.0:1788482992.210024:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:0.0:1788482992.210038:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+11:10365:x1875360063980416:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:0.0:1788482992.210077:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482992.210123:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad78f5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a69 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.210275:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.210293:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.210308:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.210325:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.210333:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.210367:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.211393:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.211412:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 12 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.211423:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.211473:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 12 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.211493:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 12 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482992.211512:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072402048:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788482992.212447:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb907103300 going to sleep for 11 seconds 00000100:00080000:1.0:1788482992.212746:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482992.224176:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482992.224433:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063980672 00000100:00100000:2.0:1788482992.224450:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063980672 00000100:00100000:2.0:1788482992.224525:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1788482992.224540:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+13:5592:x1875360063980672:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788482992.224717:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072402048:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788482992.224765:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482992.225241:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+14:5592:x1875360063980672:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 702us (1087us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788482992.225300:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1788482992.228393:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482992.228514:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063980800 00000100:00100000:0.0:1788482992.228535:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063980800 00010000:00010000:0.0:1788482992.228685:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 14 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482992.228749:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1788482992.228765:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+14:2352:x1875360063980800:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482992.229689:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482992.229708:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 14 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.229732:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 14 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.229765:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78f43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a62 expref: 14 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.229792:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788482992.229799:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.229825:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.229835:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.229888:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482992.229985:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+13:2352:x1875360063980800:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 1223us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482992.229994:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00010000:00010000:3.0:1788482992.231926:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.231948:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482992.232032:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788482992.232038:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788482992.232120:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232142:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232166:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232175:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232183:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232189:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482992.232195:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232223:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232243:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482992.232247:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482992.232289:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232295:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad78f66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232316:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232323:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232328:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232332:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482992.232335:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232341:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232348:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb907174500) 00010000:00010000:3.0:1788482992.232350:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482992.232354:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232368:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad78f6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232426:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad78f5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a69 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232441:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a69 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.232449:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482992.232452:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788482992.232455:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368800, rc 0) 00000100:00100000:3.0:1788482992.234066:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+12:10365:x1875360063980416:12345-192.168.201.6@tcp:101:stat.0 Request processed in 24016us (24613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482992.234082:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1788482992.321629:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.321783:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063981056 00000100:00100000:1.0:1788482992.321808:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063981056 00000100:00100000:1.0:1788482992.321941:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1788482992.321954:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+12:10371:x1875360063981056:12345-192.168.201.6@tcp:36:truncate.0 00010000:00010000:1.0:1788482992.322061:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482992.322101:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad78f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a69 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.322128:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788482992.322135:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788482992.322978:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.322999:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.323012:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788482992.323075:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788482992.323101:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000292e564 reply state 00000000ba198dd8 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482992.323112:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788482992.323706:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+14:10371:x1875360063981056:12345-192.168.201.6@tcp:36:truncate.0 Request processed in 1749us (2091us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788482992.323717:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000020:00080000:1.0:1788482992.323724:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788482992.325754:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.325779:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.325789:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.325924:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482992.325931:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.325940:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.325965:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788482992.325968:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482992.325973:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.325980:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482992.474341:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482992.474513:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063981184 00000100:00100000:3.0:1788482992.474528:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063981184 00000100:00100000:3.0:1788482992.474679:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:3.0:1788482992.474694:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+13:10385:x1875360063981184:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:3.0:1788482992.474728:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482992.474757:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78f82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a70 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.474972:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.474992:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.475027:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.475047:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.475054:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.475062:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.475523:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476106:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476121:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482992.476224:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788482992.476231:0:6958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788482992.476300:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476314:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476324:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476347:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476354:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476362:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482992.476367:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476375:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476392:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482992.476396:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482992.476403:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476409:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad78f89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476429:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476436:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476443:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476448:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482992.476457:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476464:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476473:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9231eb500) 00010000:00010000:3.0:1788482992.476476:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482992.476479:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476486:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78f90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476610:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78f82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 15 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476629:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 14 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.476637:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482992.476640:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788482992.476643:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492e00, rc 0) 00000100:00100000:3.0:1788482992.476899:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+14:10385:x1875360063981184:12345-192.168.201.6@tcp:101:stat.0 Request processed in 2206us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482992.476910:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:0.0:1788482992.563295:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072402176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482992.563416:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482992.563583:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072402176 00000100:00100000:2.0:1788482992.563598:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072402176 00000100:00100000:2.0:1788482992.563675:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788482992.563690:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072402176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788482992.563750:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788482992.563982:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072402176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482992.563988:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788482992.564128:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072402176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788482992.565346:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.565454:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063981440 00000100:00100000:1.0:1788482992.565464:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063981440 00000100:00100000:1.0:1788482992.565620:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:1.0:1788482992.565635:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+14:10395:x1875360063981440:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788482992.565665:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482992.565703:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a77 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482992.566217:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1788482992.566469:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a77 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.566486:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:1.0:1788482992.566495:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788482992.566503:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad78f9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a77 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.566520:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627c00, rc 0) 00000100:00100000:1.0:1788482992.566725:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+15:10395:x1875360063981440:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1093us (1383us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788482992.566732:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:2.0:1788482992.569630:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.569710:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063981696 00000100:00100000:1.0:1788482992.569724:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063981696 00000100:00100000:1.0:1788482992.569876:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:1.0:1788482992.569891:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+15:10395:x1875360063981696:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482992.570729:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+16:10395:x1875360063981696:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 838us (1108us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788482992.570737:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1788482992.607403:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482992.607464:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482992.607513:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.607649:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063981824 00000100:00100000:1.0:1788482992.607665:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063981824 00000100:00100000:1.0:1788482992.607748:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 289 00000100:00100000:1.0:1788482992.607764:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063981824:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788482992.607895:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2354:x1875360063981824:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 135us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482992.607904:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 289 00000100:00100000:0.0:1788482992.608364:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063982080 00000100:00100000:0.0:1788482992.608370:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063982080 00000100:00100000:0.0:1788482992.608446:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:0.0:1788482992.608455:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063982080:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482992.608528:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2354:x1875360063982080:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 75us (1063us total) trans 0 rc 0/0 00000100:00080000:1.0:1788482992.608627:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788482992.608717:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:3.0:1788482992.608979:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063981952 00000100:00100000:3.0:1788482992.608987:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063981952 00000100:00100000:3.0:1788482992.609051:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:3.0:1788482992.609061:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:2354:x1875360063981952:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788482992.609129:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:2354:x1875360063981952:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 71us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482992.609137:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00080000:1.0:1788482992.609217:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788482992.614644:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482992.614874:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063982336 00000100:00100000:3.0:1788482992.614893:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063982336 00000100:00100000:3.0:1788482992.615048:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:3.0:1788482992.615065:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+16:10401:x1875360063982336:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788482992.615115:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482992.615164:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78fac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a7e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.615369:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.615388:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 17 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.615408:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.615459:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 17 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.615475:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 17 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482992.615501:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072402304:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482992.615755:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb92e957000 going to sleep for 11 seconds 00000100:00100000:0.0:1788482992.619913:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921647b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072402304:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482992.619962:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482992.620515:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482992.621095:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063982464 00000100:00100000:3.0:1788482992.621110:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063982464 00010000:00010000:3.0:1788482992.621171:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 18 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482992.621222:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:3.0:1788482992.621236:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+18:2352:x1875360063982464:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482992.621302:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482992.621312:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 18 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.621327:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 18 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.621357:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad78f97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a70 expref: 18 pid: 6958 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.621384:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482992.621391:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.621402:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.621412:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.621443:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482992.621727:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+17:2352:x1875360063982464:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 492us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482992.621736:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00010000:00010000:2.0:1788482992.621992:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.622000:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482992.622030:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788482992.622290:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad78fac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.622322:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.622332:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788482992.622335:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788482992.622338:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493a00, rc 0) 00000100:00100000:2.0:1788482992.622378:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+17:10401:x1875360063982336:12345-192.168.201.6@tcp:101:bash.0 Request processed in 7318us (7756us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788482992.622387:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:3.0:1788482992.625528:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482992.625693:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063982720 00000100:00100000:0.0:1788482992.625708:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063982720 00000100:00100000:0.0:1788482992.625776:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:0.0:1788482992.625789:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+17:10401:x1875360063982720:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:0.0:1788482992.626293:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.626312:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.626323:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788482992.626378:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788482992.626400:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e09f2b0a reply state 00000000ddf02f49 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482992.626408:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788482992.626589:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+20:10401:x1875360063982720:12345-192.168.201.6@tcp:36:bash.0 Request processed in 799us (1076us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788482992.626596:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000020:00080000:0.0:1788482992.626601:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788482992.635364:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.635402:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.635412:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.635419:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482992.635428:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.635436:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.635459:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482992.635462:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482992.635468:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.635475:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad78fc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482992.638014:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482992.638661:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063982848 00000100:00100000:0.0:1788482992.638680:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063982848 00000100:00100000:0.0:1788482992.638948:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:0.0:1788482992.638964:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+19:10401:x1875360063982848:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788482992.639006:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482992.639040:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78fc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a85 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.639209:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.639228:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.639238:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.639323:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.639340:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 20 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482992.639357:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9071b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072402432:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788482992.639513:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb907103000 going to sleep for 11 seconds 00000100:00100000:0.0:1788482992.643060:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482992.643700:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063982976 00000100:00100000:3.0:1788482992.643714:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063982976 00010000:00010000:3.0:1788482992.643781:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 21 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482992.644030:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9071b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072402432:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482992.644071:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482992.644283:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:3.0:1788482992.644296:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+21:2351:x1875360063982976:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482992.644315:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482992.644324:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 21 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.644339:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 21 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.644367:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad78fb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a7e expref: 21 pid: 5807 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.644391:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482992.644397:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.644409:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.644419:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.644443:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482992.644520:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+20:2351:x1875360063982976:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 226us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482992.644528:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00010000:00010000:1.0:1788482992.644790:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.644872:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482992.644957:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788482992.644964:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482992.644992:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.645038:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad78fc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a85 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.645060:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a85 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.645071:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788482992.645074:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788482992.645077:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369a00, rc 0) 00000100:00100000:1.0:1788482992.645707:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+19:10401:x1875360063982848:12345-192.168.201.6@tcp:101:bash.0 Request processed in 6743us (7711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482992.645717:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1788482992.651505:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.651732:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063983232 00000100:00100000:1.0:1788482992.651750:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063983232 00000100:00100000:1.0:1788482992.651843:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788482992.651865:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb91888a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+19:10401:x1875360063983232:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:1.0:1788482992.652306:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb91888a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+20:10401:x1875360063983232:12345-192.168.201.6@tcp:35:bash.0 Request processed in 451us (825us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788482992.652322:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1788482992.710337:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482992.710393:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063983488 00000100:00100000:0.0:1788482992.710409:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063983488 00000100:00100000:0.0:1788482992.710492:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:0.0:1788482992.710507:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+20:10411:x1875360063983488:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788482992.710614:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482992.710648:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78fd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a8c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482992.711023:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788482992.711283:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78fd6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a8c expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.711299:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:0.0:1788482992.711301:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788482992.711306:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad78fd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a8c expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.711320:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368400, rc 0) 00000100:00100000:0.0:1788482992.711399:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+21:10411:x1875360063983488:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 895us (1080us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788482992.711408:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:0.0:1788482992.714578:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482992.714648:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063983616 00000100:00100000:2.0:1788482992.714663:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063983616 00000100:00100000:2.0:1788482992.714750:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:2.0:1788482992.714764:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+21:10411:x1875360063983616:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:2.0:1788482992.714981:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.714999:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715009:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715022:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715028:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715054:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715489:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715499:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715508:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788482992.715581:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715597:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715604:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715610:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715614:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482992.715618:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715624:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715639:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:2.0:1788482992.715649:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482992.715656:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715663:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad78fe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715681:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715685:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715690:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715692:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482992.715694:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715697:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715702:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb911fa9400) 00010000:00010000:2.0:1788482992.715704:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482992.715705:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715709:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad78feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715721:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715729:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715732:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715735:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482992.715737:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715740:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715744:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788482992.715745:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482992.715747:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.715750:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482992.715842:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+21:10411:x1875360063983616:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1079us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482992.715863:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1788482992.717924:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.718098:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063983872 00000100:00100000:1.0:1788482992.718110:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063983872 00000100:00100000:1.0:1788482992.718178:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788482992.718190:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+21:10411:x1875360063983872:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482992.718904:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+22:10411:x1875360063983872:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 714us (988us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788482992.718914:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788482992.760124:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482992.760316:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063984128 00000100:00100000:2.0:1788482992.760334:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063984128 00000100:00100000:2.0:1788482992.760426:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1788482992.760441:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+22:10414:x1875360063984128:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788482992.760477:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482992.760799:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a93 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.761380:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.761401:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.761417:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.761436:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.761444:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.761450:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.762920:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7900e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.762942:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7900e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.762954:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7900e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482992.762968:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788482992.763142:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763305:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763313:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763321:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482992.763326:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763333:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763345:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:2.0:1788482992.763348:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482992.763353:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763359:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763378:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763383:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763389:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763394:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482992.763406:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763413:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763421:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb911fa9400) 00010000:00010000:2.0:1788482992.763424:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482992.763427:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763433:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79007 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763803:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad78ff9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a93 expref: 25 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763823:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7900e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a93 expref: 24 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482992.763832:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788482992.763835:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788482992.763839:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780c00, rc 0) 00000100:00100000:2.0:1788482992.763972:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+24:10414:x1875360063984128:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 3532us (3858us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788482992.763983:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1788482992.769327:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482992.769604:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482992.769672:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063984384 00000100:00100000:3.0:1788482992.769689:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063984384 00000100:00100000:3.0:1788482992.769778:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:3.0:1788482992.769789:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+24:2352:x1875360063984384:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482992.769811:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482992.769847:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7900e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a93 expref: 24 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.769888:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788482992.769897:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482992.770213:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063984256 00000100:00100000:1.0:1788482992.770219:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063984256 00000100:00100000:1.0:1788482992.770280:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:1.0:1788482992.770360:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+24:10414:x1875360063984256:12345-192.168.201.6@tcp:54:lfs.0 00000100:00100000:3.0:1788482992.770494:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+24:2352:x1875360063984384:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 704us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482992.770502:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00010000:00010000:1.0:1788482992.771011:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771031:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771045:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771084:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771093:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771100:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771127:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482992.771133:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771142:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771153:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788482992.771157:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788482992.771162:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.771168:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7901c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482992.771283:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+23:10414:x1875360063984256:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 961us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482992.771291:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:0.0:1788482992.774215:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.774354:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063984640 00000100:00100000:1.0:1788482992.774371:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063984640 00000100:00100000:1.0:1788482992.774451:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:1.0:1788482992.774478:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+23:10414:x1875360063984640:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482992.774875:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+24:10414:x1875360063984640:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 410us (672us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788482992.774883:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788482992.943999:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482992.944419:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063984896 00000100:00100000:0.0:1788482992.944435:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063984896 00000100:00100000:0.0:1788482992.944540:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:0.0:1788482992.944554:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+24:10432:x1875360063984896:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1788482992.944595:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482992.944642:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad79023 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077a9a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.944817:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad7902a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.944837:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad7902a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.944865:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad7902a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482992.944884:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788482992.945117:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad79023 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a9a expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.945145:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad7902a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a9a expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482992.945758:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788482992.945763:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788482992.945768:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369800, rc 0) 00000100:00100000:0.0:1788482992.945966:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+26:10432:x1875360063984896:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1411us (1985us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788482992.945976:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:2.0:1788482992.977949:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482992.978536:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063985024 00000100:00100000:3.0:1788482992.978551:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063985024 00000100:00100000:3.0:1788482992.978750:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:3.0:1788482992.978766:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+26:10433:x1875360063985024:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482992.978816:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482992.978845:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077aa1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.978955:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7903f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.978996:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7903f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.979011:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7903f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482992.979520:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1788482992.979526:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788482992.979633:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7903f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.979676:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa1 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.979699:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7903f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa1 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482992.979710:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482992.979713:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788482992.979718:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492e00, rc 0) 00000100:00100000:3.0:1788482992.979816:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+27:10433:x1875360063985024:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1052us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482992.979825:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:2.0:1788482992.989808:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.989987:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063985408 00000100:00100000:1.0:1788482992.990005:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063985408 00000100:00100000:1.0:1788482992.990094:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788482992.990131:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+27:10433:x1875360063985408:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482992.990760:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+28:10433:x1875360063985408:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 630us (986us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788482992.990771:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:2.0:1788482992.994922:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482992.995049:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063985536 00000100:00100000:1.0:1788482992.995064:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063985536 00000100:00100000:1.0:1788482992.995530:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788482992.995546:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+28:10433:x1875360063985536:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:1.0:1788482992.995570:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788482992.995628:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad78fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a85 expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.995659:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad7902a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a9a expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.995675:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad78ed3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a46 expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482992.995688:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788482992.995705:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482992.995920:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+25:10433:x1875360063985536:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 378us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482992.995929:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:2.0:1788482992.999730:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482992.999930:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063985664 00000100:00100000:3.0:1788482992.999946:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063985664 00000100:00100000:3.0:1788482993.000086:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:3.0:1788482993.000100:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+25:10433:x1875360063985664:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:3.0:1788482993.000778:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.000826:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.000845:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788482993.004930:0:6958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788482993.005927:0:6958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788482993.006543:0:6958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788482993.006922:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+25:10433:x1875360063985664:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 6814us (7198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.006939:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00010000:00010000:0.0:1788482993.010744:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482993.039595:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482993.039981:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063985792 00000100:00100000:1.0:1788482993.039995:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063985792 00000100:00100000:1.0:1788482993.040086:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:1.0:1788482993.040099:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+25:10435:x1875360063985792:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788482993.040144:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482993.040187:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7904d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077aa8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040345:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040366:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040380:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040398:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040405:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040421:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040866:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040878:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.040885:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482993.040942:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788482993.040956:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482993.040987:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041006:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041017:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041026:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041035:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041043:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482993.041049:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041059:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041075:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:1.0:1788482993.041078:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482993.041084:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041091:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79054 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041107:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041123:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041129:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041134:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482993.041137:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041144:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041151:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9050b3900) 00010000:00010000:1.0:1788482993.041153:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482993.041155:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041161:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad7905b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041204:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7904d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041219:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.041227:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231eb500) 00010000:00010000:1.0:1788482993.041229:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788482993.041237:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627a00, rc 0) 00000100:00100000:1.0:1788482993.041397:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+26:10435:x1875360063985792:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1299us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.041405:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00000040:00080000:3.0:1788482993.842604:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788482993.842620:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788482993.842698:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788482993.842706:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788482993.842971:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921647b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072402560:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788482993.843196:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb92e9579c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482993.861551:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482993.861607:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063985920 00000100:00100000:2.0:1788482993.861618:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063985920 00000100:00100000:2.0:1788482993.861689:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1788482993.861703:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa30c745-265d-4a44-8753-67e411452897+27:10446:x1875360063985920:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788482993.861826:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa30c745-265d-4a44-8753-67e411452897+27:10446:x1875360063985920:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.861843:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788482993.865232:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921647b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072402560:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788482993.879387:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482993.879501:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063986048 00000100:00100000:3.0:1788482993.879515:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063986048 00000100:00100000:3.0:1788482993.879617:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:3.0:1788482993.879634:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+26:10446:x1875360063986048:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788482993.879686:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788482993.879866:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+26:10446:x1875360063986048:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 235us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482993.879875:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:2.0:1788482993.896794:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482993.897315:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063986176 00000100:00100000:1.0:1788482993.897341:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063986176 00000100:00100000:1.0:1788482993.897424:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:1.0:1788482993.897437:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+26:10446:x1875360063986176:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788482993.897540:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897561:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897577:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897597:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897605:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897611:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897650:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897659:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897687:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482993.897736:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788482993.897741:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482993.897765:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897794:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897802:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897810:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897817:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482993.897823:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897831:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897857:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:1.0:1788482993.897861:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482993.897868:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897875:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad79069 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897904:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897910:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897917:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897923:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482993.897926:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897933:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897943:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9eb9050b3b00) 00010000:00010000:1.0:1788482993.897945:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482993.897949:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897954:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79070 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897972:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897979:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897984:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.897996:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482993.897999:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.898005:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.898014:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231eb500) 00010000:00010000:1.0:1788482993.898016:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482993.898019:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482993.898024:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79077 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482993.898152:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+26:10446:x1875360063986176:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 716us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482993.898174:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:0.0:1788482993.908921:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482993.909078:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063986432 00000100:00100000:3.0:1788482993.909092:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063986432 00000100:00100000:3.0:1788482993.909171:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:3.0:1788482993.909184:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+26:10446:x1875360063986432:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788482993.909212:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482993.909288:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7907e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077aaf expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909590:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909611:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909627:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482993.909645:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788482993.909807:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909815:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909822:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909829:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482993.909843:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909852:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909871:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231eb500) 00010000:00010000:3.0:1788482993.909874:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788482993.909881:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909901:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909972:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7907e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aaf expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.909985:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:3.0:1788482993.909988:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788482993.909992:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7907e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aaf expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.910005:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492a00, rc 0) 00000100:00100000:3.0:1788482993.910122:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+27:10446:x1875360063986432:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 939us (1217us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788482993.910133:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:2.0:1788482993.926781:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482993.926935:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063986560 00000100:00100000:3.0:1788482993.926948:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063986560 00000100:00100000:3.0:1788482993.927029:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:3.0:1788482993.927043:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+27:10446:x1875360063986560:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788482993.927104:0:5809:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788482993.927245:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+27:10446:x1875360063986560:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 203us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482993.927281:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:1.0:1788482993.964583:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482993.965684:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063986816 00000100:00100000:3.0:1788482993.965704:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063986816 00000100:00100000:3.0:1788482993.965800:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:3.0:1788482993.965827:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+27:10446:x1875360063986816:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788482993.965867:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482993.965872:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788482993.965910:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7903f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa1 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.965935:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482993.965941:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788482993.965957:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79093 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ab6 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788482993.967745:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788482993.968115:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7909a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.968138:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7909a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.969689:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7909a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.969869:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79093 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ab6 expref: 29 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.969899:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7909a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ab6 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.969911:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:3.0:1788482993.969916:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788482993.969934:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493600, rc 0) 00000100:00100000:3.0:1788482993.970054:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+28:10446:x1875360063986816:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 4229us (5482us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788482993.970065:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:0.0:1788482993.991819:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482993.991956:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063987072 00000100:00100000:3.0:1788482993.991974:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063987072 00000100:00100000:3.0:1788482993.992052:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:3.0:1788482993.992074:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+28:10446:x1875360063987072:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788482993.992154:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482993.992191:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7909a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ab6 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992215:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:3.0:1788482993.992226:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788482993.992276:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992292:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992303:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992318:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992325:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992332:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992658:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992667:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992674:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992681:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482993.992686:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992694:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992703:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482993.992706:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482993.992710:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992716:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992727:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992733:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992740:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992750:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482993.992754:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992759:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992766:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x354a0744 (ffff9eb9231eb100) 00010000:00010000:3.0:1788482993.992768:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482993.992770:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482993.992776:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x354a0744 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482993.992902:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+27:10446:x1875360063987072:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 829us (1094us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788482993.992911:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:2.0:1788482993.996199:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482993.996266:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063987200 00000100:00100000:2.0:1788482993.996279:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063987200 00000100:00100000:2.0:1788482993.996350:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:2.0:1788482993.996363:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+27:10446:x1875360063987200:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788482993.996391:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482993.996423:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077abd expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482993.996472:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482993.996499:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482993.996513:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482993.996640:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 29 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482993.996663:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 28 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482993.996673:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:2.0:1788482993.996676:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788482993.996681:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780600, rc 0) 00000100:00100000:2.0:1788482993.997304:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+28:10446:x1875360063987200:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 940us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482993.997315:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:1.0:1788482994.007161:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482994.007290:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063987456 00000100:00100000:3.0:1788482994.007303:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063987456 00000100:00100000:3.0:1788482994.007381:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:3.0:1788482994.007394:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+28:10446:x1875360063987456:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788482994.007522:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.007542:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.007556:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788482994.008154:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788482994.008168:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311173917938ns, next at 312173914548ns, rc = 0 00000004:00010000:3.0:1788482994.008308:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b878b0d reply state 00000000bec8a439 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482994.008321:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788482994.008463:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+30:10446:x1875360063987456:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1070us (1314us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788482994.008473:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00080000:1.0:1788482994.008631:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788482994.011320:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.011342:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.011351:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.011358:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482994.011364:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.011373:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.011394:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:3.0:1788482994.011398:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788482994.011402:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.011425:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482994.011950:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.012164:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063987584 00000100:00100000:0.0:1788482994.012179:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063987584 00000100:00100000:0.0:1788482994.012280:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:0.0:1788482994.012294:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+29:10446:x1875360063987584:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788482994.012326:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482994.012351:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ac4 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.012430:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 30 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.012447:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 30 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.012472:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:0.0:1788482994.012475:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788482994.012479:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369000, rc 0) 00000100:00100000:0.0:1788482994.012568:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+30:10446:x1875360063987584:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 277us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482994.012576:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:2.0:1788482994.023768:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482994.023831:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063987712 00000100:00100000:2.0:1788482994.023853:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063987712 00000100:00100000:2.0:1788482994.023908:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:2.0:1788482994.023920:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875360063987712:12345-192.168.201.6@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788482994.023960:0:6663:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:2.0:1788482994.024004:0:6663:0:(genops.c:1385:class_connect()) connect: client aa30c745-265d-4a44-8753-67e411452897, cookie 0x42820277aad790d2 00002000:00100000:2.0:1788482994.024023:0:6663:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa30c745-265d-4a44-8753-67e411452897/ffff9eb910c19000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788482994.024078:0:6663:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:2.0:1788482994.024414:0:6663:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788482994.024459:0:6663:0:(import.c:65:import_set_state_nolock()) ffff9eb910c1c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788482994.024859:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+6:2350:x1875360063987712:12345-192.168.201.6@tcp:8:lhsmtool_posix.0 Request processed in 936us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482994.024870:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1788482994.028370:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482994.029326:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063987840 00000100:00100000:1.0:1788482994.029343:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063987840 00000100:00100000:1.0:1788482994.029445:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1788482994.029461:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:0:x1875360063987840:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788482994.030761:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788482994.041426:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788482994.052088:0:11978:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788482994.052104:0:11978:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788482994.052155:0:11978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788482994.052166:0:11978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788482994.173362:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788482994.173399:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000100:00100000:3.0:1788482994.174236:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:0:x1875360063987840:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 144591us (145694us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788482994.174279:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:3.0:1788482994.178587:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.179092:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063988096 00000100:00100000:0.0:1788482994.179109:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063988096 00000100:00100000:0.0:1788482994.179194:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1788482994.179208:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+30:10446:x1875360063988096:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788482994.179585:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+31:10446:x1875360063988096:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 379us (1013us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788482994.179595:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:2.0:1788482994.182463:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.182555:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063988352 00000100:00100000:0.0:1788482994.182569:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063988352 00000100:00100000:0.0:1788482994.182655:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:0.0:1788482994.182670:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+31:10446:x1875360063988352:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788482994.182863:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+31:10446:x1875360063988352:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 197us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482994.182872:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:0.0:1788482994.185837:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482994.186846:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063988480 00000100:00100000:2.0:1788482994.186863:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063988480 00000100:00100000:3.0:1788482994.189128:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:3.0:1788482994.189148:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+31:10446:x1875360063988480:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788482994.189181:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482994.189214:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077acb expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.189340:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.189359:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.189373:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482994.189423:0:6958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788482994.189447:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.189477:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad790d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077acb expref: 33 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.189510:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077acb expref: 32 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.189520:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:3.0:1788482994.189524:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788482994.189528:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493400, rc 0) 00000100:00100000:3.0:1788482994.189619:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+32:10446:x1875360063988480:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 478us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482994.189627:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:0.0:1788482994.205536:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.205610:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063988608 00000100:00100000:0.0:1788482994.205623:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063988608 00000100:00100000:0.0:1788482994.205694:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:0.0:1788482994.205707:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063988608:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788482994.205803:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482994.205852:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ad2 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788482994.205896:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a15b2, blocks: 0x1 00010000:00010000:0.0:1788482994.205926:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1788482994.205932:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482994.205945:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 6 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.205988:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 6 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.206007:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369200, rc 0) 00000100:00100000:0.0:1788482994.206478:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063988608:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 769us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482994.206489:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1788482994.215043:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482994.215135:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063988864 00000100:00100000:3.0:1788482994.215149:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063988864 00000100:00100000:3.0:1788482994.215223:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:3.0:1788482994.215237:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+32:10446:x1875360063988864:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788482994.215408:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+32:10446:x1875360063988864:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 174us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482994.215416:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:2.0:1788482994.226226:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482994.233912:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063988992 00000100:00100000:3.0:1788482994.233932:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063988992 00000100:00100000:3.0:1788482994.234026:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:3.0:1788482994.234040:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:10446:x1875360063988992:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788482994.234131:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482994.234404:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ad9 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.234451:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 7 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.234472:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788482994.234477:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788482994.234485:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.234533:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 7 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.234549:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 7 pid: 6662 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482994.234566:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921644e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6660:1875360072402688:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482994.234708:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb907103300 going to sleep for 11 seconds 00000100:00100000:0.0:1788482994.244488:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.244540:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063989120 00000100:00100000:0.0:1788482994.244553:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063989120 00010000:00010000:0.0:1788482994.244618:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 8 pid: 6662 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482994.244673:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1788482994.244686:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360063989120:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482994.244706:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482994.246173:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 8 pid: 6662 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.246198:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 8 pid: 6662 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.246234:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482994.246240:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482994.246275:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.246287:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.246346:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482994.246366:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9071b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5795:1875360072402816:192.168.201.6@tcp:105: 00000100:00100000:0.0:1788482994.246493:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511780 going to sleep for 11 seconds 00010000:00010000:0.0:1788482994.246552:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d103ee/0x42820277aad790e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad2 expref: 8 pid: 6662 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482994.246568:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921644e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6660:1875360072402688:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482994.246600:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.246612:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492e00, rc 0) 00000100:00100000:0.0:1788482994.246649:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+7:10446:x1875360063988992:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 12611us (20440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482994.246659:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:0.0:1788482994.268212:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482994.268373:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063989248 00000100:00100000:2.0:1788482994.268387:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063989248 00002000:00100000:2.0:1788482994.268456:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9eb9071b2300 x1875360063989248/t0(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:500/0 lens 504/0 e 0 to 0 dl 1788483005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788482994.268470:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb9071b2300 with x1875360063989248 ext(0->8) 00002000:00010000:2.0:1788482994.268478:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb9071b2300 00000100:00100000:2.0:1788482994.268521:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788482994.268534:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360063989248:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788482994.269951:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa30c745-265d-4a44-8753-67e411452897+9:2351:x1875360063989248:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 1409us (1748us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788482994.269974:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00002000:00100000:2.0:1788482994.269987:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9eb9071b2300 x1875360063989248/t4294967302(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:500/0 lens 504/448 e 0 to 0 dl 1788483005 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788482994.269997:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb9071b2300 with x1875360063989248 ext(0->8) 00002000:00010000:2.0:1788482994.270004:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb9071b2300 00000100:00100000:3.0:1788482994.272525:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9071b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5795:1875360072402816:192.168.201.6@tcp:105: 00010000:00010000:3.0:1788482994.272565:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482994.272678:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360063989120:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 27991us (28208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482994.272695:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1788482994.278393:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482994.280911:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063989376 00000100:00100000:3.0:1788482994.280929:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063989376 00000100:00100000:3.0:1788482994.281028:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:3.0:1788482994.281042:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+32:10446:x1875360063989376:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788482994.335947:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1788482994.335978:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1788482994.336041:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788482994.336088:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788482994.336100:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788482994.336365:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+13:10446:x1875360063989376:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 55317us (57977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482994.336387:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:1.0:1788482994.337275:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072402944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788482994.337346:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482994.337533:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072402944 00000100:00100000:0.0:1788482994.337544:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072402944 00000100:00100000:0.0:1788482994.337619:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788482994.337629:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072402944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788482994.337877:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788482994.337881:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788482994 00002000:00010000:0.0:1788482994.337884:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788482994.337887:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788482994 -> 1788482994 00002000:00010000:0.0:1788482994.337889:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:2.0:1788482994.338107:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482994.338672:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3280:x1875360072402944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1039us (1322us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788482994.338685:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788482994.338876:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb93fe19f80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788482994.338885:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072402944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788482994.346113:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482994.347428:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063989504 00000100:00100000:3.0:1788482994.347444:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063989504 00000100:00100000:3.0:1788482994.347695:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:3.0:1788482994.347709:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+8:2353:x1875360063989504:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788482994.392896:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788482994.392922:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788482994.393817:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2353:x1875360063989504:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 46098us (47709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482994.393843:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788482994.398956:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482994.404784:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063989760 00000100:00100000:3.0:1788482994.404808:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063989760 00000100:00100000:3.0:1788482994.404920:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:3.0:1788482994.404932:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+13:10446:x1875360063989760:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788482994.405008:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482994.405043:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad790e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077acb expref: 13 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.405357:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:3.0:1788482994.405363:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788482994.405402:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.405418:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.405429:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788482994.406867:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d3ff916 reply state 0000000030e6ffdd transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482994.406890:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788482994.407075:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+14:10446:x1875360063989760:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 2139us (8128us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788482994.407090:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00010000:00010000:3.0:1788482994.409986:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.410035:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.410045:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.410059:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482994.410067:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.410076:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.410099:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:3.0:1788482994.410103:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482994.410111:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.410118:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad790f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482994.417737:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.417983:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063989888 00000100:00100000:0.0:1788482994.417999:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063989888 00000100:00100000:0.0:1788482994.418093:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1788482994.418106:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063989888:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788482994.418534:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788482994.418539:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788482994 -> 1788482992 00002000:00010000:0.0:1788482994.418542:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788482991 00002000:00010000:0.0:1788482994.418545:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788482994 -> 1788482992 00002000:00010000:0.0:1788482994.418548:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788482994.418640:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360063989888:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 536us (920us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788482994.418648:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:0.0:1788482994.424611:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482994.424882:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063990144 00000100:00100000:2.0:1788482994.424897:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063990144 00000100:00100000:2.0:1788482994.424974:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:2.0:1788482994.424989:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+13:10446:x1875360063990144:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788482994.425109:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.425129:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 13 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.425140:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.425190:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 13 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.425207:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 13 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482994.425301:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072403072:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482994.425426:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034300 going to sleep for 11 seconds 00000100:00100000:1.0:1788482994.432550:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.432771:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063990272 00000100:00100000:0.0:1788482994.432785:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063990272 00010000:00010000:0.0:1788482994.432850:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 14 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482994.432903:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:0.0:1788482994.432915:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+14:2351:x1875360063990272:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482994.432934:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482994.432943:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 14 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.432961:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 14 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.432992:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:0.0:1788482994.433009:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.433021:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.433030:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.433216:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482994.433338:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+14:2351:x1875360063990272:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 423us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482994.433347:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00010000:00010000:2.0:1788482994.434686:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad790bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077abd expref: 13 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482994.434715:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072403072:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788482994.434746:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434757:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434764:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434809:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434817:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434834:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434842:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482994.434847:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434856:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434889:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:2.0:1788482994.434892:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788482994.434896:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.434903:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad790fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482994.434990:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+12:10446:x1875360063990144:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 10004us (10397us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788482994.435066:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:1.0:1788482994.439297:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482994.439455:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063990400 00000100:00100000:3.0:1788482994.439466:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063990400 00000100:00100000:3.0:1788482994.439534:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1788482994.439545:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93b173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360063990400:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788482994.439591:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.439613:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.439640:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788482994.439645:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788482994.439650:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.439690:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 7 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.439704:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 7 pid: 6660 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482994.439719:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921645f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6660:1875360072403200:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482994.439837:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb904c28300 going to sleep for 11 seconds 00000100:00100000:1.0:1788482994.445229:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.445351:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063990528 00000100:00100000:0.0:1788482994.445372:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063990528 00010000:00010000:0.0:1788482994.445458:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 8 pid: 6660 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482994.445518:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921645f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6660:1875360072403200:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788482994.445557:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482994.445647:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:0.0:1788482994.445663:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+8:2354:x1875360063990528:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482994.445689:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482994.445732:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 8 pid: 6660 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.445764:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 8 pid: 6660 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.445805:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edbade0f/0x42820277aad790ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ad9 expref: 8 pid: 6660 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.445840:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788482994.445847:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788482994.445856:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.445870:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.445914:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482994.446071:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+7:2354:x1875360063990528:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 410us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482994.446105:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00010000:00010000:1.0:1788482994.446205:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.446218:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.446307:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.446394:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.446428:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.446436:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788482994.446441:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.446449:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.446472:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.446480:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad79103 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482994.446998:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93b173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063990400:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 7449us (7743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482994.447011:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:1.0:1788482994.452668:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482994.452784:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063990784 00000100:00100000:2.0:1788482994.452808:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063990784 00000100:00100000:2.0:1788482994.452914:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:2.0:1788482994.452928:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+12:10446:x1875360063990784:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788482994.453115:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.453142:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.453157:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.453806:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.453823:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 13 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.453870:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.453919:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 13 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.453935:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 13 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482994.453956:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072403328:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482994.455687:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034300 going to sleep for 11 seconds 00000100:00100000:0.0:1788482994.475190:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482994.475340:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063990912 00000100:00100000:3.0:1788482994.475354:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063990912 00010000:00010000:3.0:1788482994.475406:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 14 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482994.475462:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1788482994.475475:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+14:2351:x1875360063990912:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482994.475522:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482994.475531:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 14 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.475549:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 14 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.475578:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:3.0:1788482994.475584:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.475597:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.475606:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.475630:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482994.475699:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+14:2351:x1875360063990912:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 226us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482994.475708:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00010000:00010000:2.0:1788482994.475942:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad790cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ac4 expref: 13 pid: 6958 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482994.475965:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072403328:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788482994.476245:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.476308:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.476314:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788482994.477238:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788482994.478323:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788482994.478409:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788482994.478592:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5807:1875360072403456:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788482994.478685:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482994.478758:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788482994.478854:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072403456 00000100:00100000:1.0:1788482994.478876:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072403456 00000100:00100000:1.0:1788482994.479015:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788482994.479025:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1875360072403456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788482994.479409:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1875360072403456:12345-0@lo:1000:mdt00_001.0 Request processed in 384us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482994.479433:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788482994.479510:0:5807:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788482994.479517:0:5807:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb93fe19f80, transno 4294967303 00000100:00100000:3.0:1788482994.479594:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5807:1875360072403456:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788482994.480233:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788482994.480470:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5807:1875360072403584:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788482994.480520:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482994.480545:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034300 going to sleep for 11 seconds 00000100:00100000:1.0:1788482994.483156:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072403584 00000100:00100000:1.0:1788482994.483179:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072403584 00000100:00100000:1.0:1788482994.483328:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788482994.483344:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1875360072403584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788482994.483754:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1875360072403584:12345-0@lo:1000:mdt00_001.0 Request processed in 413us (3230us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788482994.483763:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788482994.484165:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921645f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5807:1875360072403584:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788482994.484222:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484233:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484242:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484273:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482994.484278:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484287:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484303:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:3.0:1788482994.484306:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788482994.484311:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484317:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad79111 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484371:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484378:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484384:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484407:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482994.484411:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484417:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484427:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231eb500) 00010000:00010000:3.0:1788482994.484430:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788482994.484433:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482994.484440:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad79046 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.484515:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.484539:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.484551:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.484599:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.484619:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 16 pid: 5809 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482994.484637:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072403712:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482994.484778:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90854ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788482994.496203:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482994.496379:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072403712:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788482994.496407:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482994.496834:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063991040 00000100:00100000:1.0:1788482994.496852:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063991040 00010000:00010000:1.0:1788482994.496917:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 17 pid: 5809 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482994.496973:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:1.0:1788482994.496986:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+17:2352:x1875360063991040:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788482994.497086:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482994.497096:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 17 pid: 5809 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.497113:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 17 pid: 5809 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.497142:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79062 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aa8 expref: 17 pid: 5809 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.497164:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231eb500) 00010000:00010000:1.0:1788482994.497193:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.497207:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.497217:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.497306:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788482994.497311:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497324:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497365:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497372:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497381:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497389:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781a00 already unused, calling callback (ffffffffc214d4f0) 00000100:00100000:1.0:1788482994.497397:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+16:2352:x1875360063991040:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 409us (1203us total) trans 0 rc 0/0 00010000:00010000:2.0:1788482994.497401:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482994.497414:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00010000:00010000:2.0:1788482994.497422:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497445:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231eb500) 00010000:00010000:2.0:1788482994.497448:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482994.497452:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497459:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79118 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497475:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497481:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497487:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497499:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482994.497503:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497509:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497518:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231eb500) 00010000:00010000:2.0:1788482994.497521:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788482994.497524:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482994.497531:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7910a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482994.497855:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+15:10446:x1875360063990784:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 44924us (45196us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788482994.497867:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000020:00080000:2.0:1788482994.497876:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788482994.498117:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788482994.498122:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788482994.498150:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788482994.498156:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788482994.506375:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482994.506565:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063991296 00000100:00100000:0.0:1788482994.506575:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063991296 00000100:00100000:0.0:1788482994.506640:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:0.0:1788482994.506651:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+15:10446:x1875360063991296:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788482994.507487:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788482994.507596:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788482994.507651:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.507669:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.507680:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.507690:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.507697:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.507705:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482994.507723:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788482994.507968:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482994.507976:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.507983:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788482994.507987:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.507994:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.508007:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9eb907174e00) 00010000:00010000:1.0:1788482994.508010:0:8489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788482994.508015:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.508022:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad7911f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482994.508054:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482994.508056:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482994.508057:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788482994.508094:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+17:10446:x1875360063991296:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1441us (1729us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788482994.508114:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000020:00080000:0.0:1788482994.508119:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788482995.058619:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788482996.036922:0:12031:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788482996.036935:0:12031:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788482996.036991:0:12031:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788482996.036999:0:12031:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788482996.084346:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482996.154262:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072403968:0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.154345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482996.154402:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072404480:0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.154427:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482996.154461:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788482996.154467:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072403840:0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.154508:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482996.154534:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3278:1875360072404352:0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.154555:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482996.154579:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072404096:0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.154602:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482996.154620:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482996.154625:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072404224:0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.154646:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482996.154682:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072403968 00000100:00100000:1.0:1788482996.154689:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072403968 00000100:00100000:2.0:1788482996.154832:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072404352 00000100:00100000:2.0:1788482996.154837:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072404352 00000100:00100000:2.0:1788482996.154873:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072404096 00000100:00100000:2.0:1788482996.154876:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072404096 00000100:00100000:2.0:1788482996.154893:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788482996.154901:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072403968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482996.154968:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072403968:12345-0@lo:400:kworker.0 Request processed in 67us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482996.154975:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788482996.155010:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788482996.155016:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875360072404352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482996.155046:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875360072404352:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482996.155052:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788482996.155066:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788482996.155072:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788482996.155102:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072404096:12345-0@lo:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482996.155108:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788482996.155202:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3278:1875360072404352:0@lo:400:kworker.0 00000100:00100000:3.0:1788482996.155217:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072403968:0@lo:400:kworker.0 00000100:00080000:2.0:1788482996.158409:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788482996.160223:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072404480 00000100:00100000:1.0:1788482996.160244:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072404480 00000100:00100000:1.0:1788482996.160355:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072404224 00000100:00100000:1.0:1788482996.160371:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072404224 00000100:00100000:1.0:1788482996.160401:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788482996.160412:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875360072404480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.161426:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875360072404480:12345-0@lo:400:kworker.0 Request processed in 1009us (6990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.161440:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788482996.161472:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788482996.161628:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072404480:0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.161689:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072404224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.161735:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072404224:12345-0@lo:400:kworker.0 Request processed in 256us (7088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.161741:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788482996.161763:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072403840 00000100:00100000:1.0:1788482996.161769:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072403840 00000100:00100000:1.0:1788482996.161846:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788482996.161853:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3278:x1875360072403840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788482996.161899:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3278:x1875360072403840:12345-0@lo:400:kworker.0 Request processed in 46us (7390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.161905:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:1.0:1788482996.170458:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788482996.170471:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788482996.170546:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072403840:0@lo:400:kworker.0 00000100:00100000:2.0:1788482996.173410:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072404224:0@lo:400:kworker.0 00000100:00100000:2.0:1788482996.173427:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f161f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072404096:0@lo:400:kworker.0 00000100:00100000:2.0:1788482996.241327:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000001:00080000:2.0:1788482996.241374:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1788482996.241388:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788482996.241497:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063991552 00000100:00100000:3.0:1788482996.241508:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063991552 00000100:00100000:3.0:1788482996.241579:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:3.0:1788482996.241590:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+17:10464:x1875360063991552:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482996.241618:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482996.241641:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ae0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.241915:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad7912d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.241931:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad7912d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.241944:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad7912d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482996.241957:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1788482996.242151:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae0 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.242170:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad7912d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae0 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.242181:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482996.242185:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788482996.242190:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493a00, rc 0) 00000100:00100000:3.0:1788482996.242289:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+19:10464:x1875360063991552:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 701us (972us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788482996.242298:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00080000:2.0:1788482996.243410:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482996.249303:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482996.249581:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063991680 00000100:00100000:0.0:1788482996.249595:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063991680 00000100:00100000:0.0:1788482996.249681:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:0.0:1788482996.249693:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+19:10464:x1875360063991680:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1788482996.249823:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.249844:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.249859:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.249875:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.249883:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.249889:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250227:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250237:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250327:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788482996.250376:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250391:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250399:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250407:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250413:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.250418:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250425:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250441:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:0.0:1788482996.250443:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.250449:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250454:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7913b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250465:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250565:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250571:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250576:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.250580:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250587:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250596:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb907174700) 00010000:00010000:0.0:1788482996.250598:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.250601:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250607:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250622:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250628:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250634:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250638:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.250649:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250655:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250662:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb907174b00) 00010000:00010000:0.0:1788482996.250665:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.250668:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.250673:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482996.250787:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+19:10464:x1875360063991680:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1094us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482996.250807:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:1.0:1788482996.347821:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.347969:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063991936 00000100:00100000:3.0:1788482996.347982:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063991936 00000100:00100000:3.0:1788482996.348107:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:3.0:1788482996.348119:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+19:10467:x1875360063991936:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482996.348140:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482996.348176:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ae7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348290:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348304:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348316:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348334:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348341:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348348:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348691:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348701:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348708:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482996.348721:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788482996.348845:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348863:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348870:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348876:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482996.348881:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348889:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348902:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482996.348906:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482996.348910:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348916:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348929:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348936:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348942:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348948:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482996.348957:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348964:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348973:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9231eb100) 00010000:00010000:3.0:1788482996.348976:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482996.348979:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.348985:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7915e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.349028:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.349042:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.349051:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:3.0:1788482996.349054:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788482996.349056:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492e00, rc 0) 00000100:00100000:3.0:1788482996.349121:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+21:10467:x1875360063991936:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1004us (1309us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788482996.349129:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:2.0:1788482996.357568:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.357729:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063992064 00000100:00100000:3.0:1788482996.357740:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063992064 00000100:00100000:3.0:1788482996.357801:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:3.0:1788482996.357815:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+21:10467:x1875360063992064:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1788482996.357903:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.357921:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.357933:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.357960:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.357967:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.357973:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.357980:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482996.357985:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.357992:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.358006:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:3.0:1788482996.358009:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788482996.358014:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.358020:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482996.358323:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+21:10467:x1875360063992064:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 509us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482996.358330:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:2.0:1788482996.362650:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.362706:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063992320 00000100:00100000:3.0:1788482996.362842:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063992320 00000100:00100000:3.0:1788482996.362893:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1788482996.362900:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb91888b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+21:10467:x1875360063992320:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788482996.363355:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb91888b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+22:10467:x1875360063992320:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 454us (713us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788482996.363362:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:2.0:1788482996.429379:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482996.431477:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063992576 00000100:00100000:0.0:1788482996.431496:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063992576 00000100:00100000:0.0:1788482996.431596:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:0.0:1788482996.431610:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+22:9988:x1875360063992576:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788482996.431646:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482996.431680:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7917a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077aee expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.431813:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.431831:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.431864:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.431905:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.431920:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 23 pid: 5806 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482996.431937:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9071b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072404608:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788482996.432077:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e0a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788482996.435575:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9071b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072404608:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482996.435616:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482996.444007:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482996.444104:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063992704 00000100:00100000:1.0:1788482996.444119:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063992704 00010000:00010000:1.0:1788482996.444179:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 24 pid: 5806 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482996.444304:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:1.0:1788482996.444316:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+24:2353:x1875360063992704:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788482996.444332:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482996.444339:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 24 pid: 5806 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.444353:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 24 pid: 5806 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.444375:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae7 expref: 24 pid: 5806 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.444393:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:1.0:1788482996.444399:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.444410:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.444418:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.444454:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482996.444506:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+23:2353:x1875360063992704:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 193us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.444515:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00010000:00010000:2.0:1788482996.444899:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.444923:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482996.444947:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788482996.445139:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7917a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.445158:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.445166:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:2.0:1788482996.445168:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788482996.445171:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368600, rc 0) 00000100:00100000:2.0:1788482996.445217:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+23:9988:x1875360063992576:12345-192.168.201.6@tcp:101:bash.0 Request processed in 13611us (15849us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788482996.445225:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:2.0:1788482996.450112:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.450289:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063992960 00000100:00100000:3.0:1788482996.450301:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063992960 00000100:00100000:3.0:1788482996.450355:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:3.0:1788482996.450365:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+23:9988:x1875360063992960:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:3.0:1788482996.450701:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.450725:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.450740:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788482996.450819:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788482996.450851:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000317ac742 reply state 00000000792eddec transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482996.450884:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788482996.450940:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788482996.451085:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+27:9988:x1875360063992960:12345-192.168.201.6@tcp:36:bash.0 Request processed in 719us (982us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788482996.451092:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 89 00000020:00080000:3.0:1788482996.451098:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788482996.454992:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482996.455163:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063993088 00000100:00100000:2.0:1788482996.455176:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063993088 00000100:00100000:2.0:1788482996.455279:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:2.0:1788482996.455291:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+27:9988:x1875360063993088:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788482996.455322:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482996.455348:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077af5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.455441:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077af5 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.455473:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077af5 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.455494:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:2.0:1788482996.455497:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788482996.455501:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781800, rc 0) 00000100:00100000:2.0:1788482996.455581:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+28:9988:x1875360063993088:12345-192.168.201.6@tcp:101:bash.0 Request processed in 292us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482996.455589:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00010000:00010000:3.0:1788482996.457768:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.457787:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.458747:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.458756:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482996.458761:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.458769:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.458803:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:3.0:1788482996.458806:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482996.458812:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.458818:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7918f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482996.463983:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.464298:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063993216 00000100:00100000:3.0:1788482996.464336:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063993216 00000100:00080000:2.0:1788482996.464541:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788482996.464742:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1788482996.464756:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+6:9988:x1875360063993216:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788482996.464774:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482996.464810:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077afc expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788482996.464848:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9a15b0, atime: 0x6a9a15af, ctime: 0x6a9a15b0, blocks: 0xb 00010000:00010000:0.0:1788482996.464873:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:0.0:1788482996.464878:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482996.464886:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.464914:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.464927:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368400, rc 0) 00000100:00100000:0.0:1788482996.465007:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:9988:x1875360063993216:12345-192.168.201.6@tcp:101:bash.0 Request processed in 254us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482996.465024:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:1.0:1788482996.471696:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482996.471837:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063993344 00000100:00100000:2.0:1788482996.471850:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063993344 00002000:00010000:2.0:1788482996.471902:0:6666:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788482996.471907:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb903110e00 with x1875360063993344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788482996.471920:0:6666:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb903110e00. 00000100:00100000:2.0:1788482996.471969:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:2.0:1788482996.471981:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360063993344:12345-192.168.201.6@tcp:10:bash.0 00002000:00010000:2.0:1788482996.472867:0:6666:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788482996.472874:0:6666:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788482992 -> 1788482996 00002000:00010000:2.0:1788482996.472877:0:6666:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788482991 -> 1788482991 00002000:00010000:2.0:1788482996.472879:0:6666:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788482992 -> 1788482996 00002000:00010000:2.0:1788482996.472882:0:6666:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788482996.472954:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360063993344:12345-192.168.201.6@tcp:10:bash.0 Request processed in 974us (1276us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788482996.472982:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00002000:00010000:2.0:1788482996.472987:0:6666:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788482996.472991:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb903110e00 with x1875360063993344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788482996.472998:0:6666:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb903110e00. 00000100:00100000:3.0:1788482996.540574:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482996.542485:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063993472 00000100:00100000:0.0:1788482996.542504:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063993472 00000100:00100000:0.0:1788482996.542599:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:0.0:1788482996.542615:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+27:10481:x1875360063993472:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1788482996.542713:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.542733:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.542746:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.542765:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.542772:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.542779:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543154:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543164:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543171:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788482996.543212:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543225:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543231:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543239:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543245:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.543291:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543313:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543327:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:0.0:1788482996.543330:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.543335:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543348:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad791a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543361:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543366:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543372:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543376:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.543379:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543386:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543394:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb907174700) 00010000:00010000:0.0:1788482996.543397:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.543399:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543404:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543419:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543425:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543437:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543442:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.543446:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543452:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543461:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:0.0:1788482996.543463:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.543466:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.543472:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad791b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482996.543569:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+27:10481:x1875360063993472:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 956us (3086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482996.543577:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:2.0:1788482996.580384:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.580605:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063993728 00000100:00100000:3.0:1788482996.580620:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063993728 00000100:00100000:3.0:1788482996.580720:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:3.0:1788482996.580736:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+27:10484:x1875360063993728:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482996.580776:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482996.580822:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad791b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b03 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.580958:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.580979:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.580994:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.581020:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.581029:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.581036:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.581973:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad791ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.581991:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad791ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.582010:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad791ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482996.582026:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788482996.583061:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583075:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583084:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583091:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482996.583097:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583106:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583194:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482996.583198:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482996.583204:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583211:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad791c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583230:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583236:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583450:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583456:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482996.583458:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583465:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583475:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9231eb100) 00010000:00010000:3.0:1788482996.583478:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482996.583481:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583487:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad791c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583631:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad791b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b03 expref: 30 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583649:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad791ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b03 expref: 29 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.583658:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:3.0:1788482996.583660:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788482996.583663:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493600, rc 0) 00000100:00100000:3.0:1788482996.583800:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+29:10484:x1875360063993728:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 3057us (3420us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788482996.583823:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:2.0:1788482996.590153:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482996.590350:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063993856 00000100:00100000:0.0:1788482996.590365:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063993856 00000100:00100000:0.0:1788482996.590450:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:0.0:1788482996.590466:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+29:10484:x1875360063993856:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:0.0:1788482996.590709:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.590733:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.590765:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.590827:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.590857:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 29 pid: 5807 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482996.590878:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9071b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072404736:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788482996.591302:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e0a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788482996.595657:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9071b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072404736:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788482996.595707:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482996.595780:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482996.595889:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063994112 00000100:00100000:1.0:1788482996.595902:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063994112 00000100:00100000:1.0:1788482996.595992:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1788482996.596009:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+30:9237:x1875360063994112:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788482996.597012:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+31:9237:x1875360063994112:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 1001us (1225us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788482996.597025:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:2.0:1788482996.607817:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.609375:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063994240 00000100:00100000:3.0:1788482996.609403:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063994240 00010000:00010000:3.0:1788482996.609514:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 31 pid: 5807 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482996.609591:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:3.0:1788482996.609607:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+31:2352:x1875360063994240:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482996.609634:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482996.609644:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 31 pid: 5807 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.609664:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 31 pid: 5807 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.609702:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79181 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077aee expref: 31 pid: 5807 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.609746:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:3.0:1788482996.609754:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.609770:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.609816:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.609865:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482996.609968:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+30:2352:x1875360063994240:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 364us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482996.609978:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00010000:00010000:0.0:1788482996.611360:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.611379:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.611431:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.611438:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.611447:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.611454:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.611460:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.611489:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.611518:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:0.0:1788482996.611521:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788482996.611526:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.611533:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482996.611657:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+29:10484:x1875360063993856:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 21190us (21519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482996.611668:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:2.0:1788482996.614639:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.614773:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063994496 00000100:00100000:3.0:1788482996.614796:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063994496 00000100:00100000:3.0:1788482996.614870:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1788482996.614884:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+29:10484:x1875360063994496:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788482996.615690:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+30:10484:x1875360063994496:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 804us (1062us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788482996.615700:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1788482996.659031:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788482996.659065:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072404864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788482996.659187:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482996.659929:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072404864 00000100:00100000:1.0:1788482996.659945:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072404864 00000100:00100000:1.0:1788482996.660038:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788482996.660053:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072404864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788482996.660108:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788482996.660217:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072404864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.660226:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788482996.660406:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788482996.660414:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1788482996.660446:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb93f163100, transno 4294967301 00000100:00100000:2.0:1788482996.660476:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072404864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788482996.709621:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482996.710453:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063994752 00000100:00100000:0.0:1788482996.710470:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063994752 00000100:00100000:0.0:1788482996.710570:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:0.0:1788482996.710585:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+30:10495:x1875360063994752:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1788482996.710621:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482996.710652:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b0a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.710760:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.710779:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.710803:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.710842:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.710852:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.710859:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714627:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad791f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714662:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad791f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714679:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad791f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482996.714696:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788482996.714871:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714880:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714889:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714896:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.714904:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714937:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714955:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:0.0:1788482996.714958:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.714964:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714971:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad791ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714988:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.714994:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.715001:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.715007:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.715652:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.715666:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.715677:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb907174700) 00010000:00010000:0.0:1788482996.715680:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.715684:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.715704:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad791f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.715780:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad791e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b0a expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.715806:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad791f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b0a expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.715814:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:0.0:1788482996.715817:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788482996.715819:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369200, rc 0) 00000100:00100000:0.0:1788482996.715925:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+32:10495:x1875360063994752:12345-192.168.201.6@tcp:101:cat.0 Request processed in 5341us (6321us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788482996.715936:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:0.0:1788482996.721716:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482996.721836:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063995008 00000100:00100000:1.0:1788482996.721852:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063995008 00000100:00100000:1.0:1788482996.721938:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1788482996.721953:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+32:10495:x1875360063995008:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:1.0:1788482996.722453:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+33:10495:x1875360063995008:12345-192.168.201.6@tcp:35:cat.0 Request processed in 502us (753us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788482996.722462:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:2.0:1788482996.763971:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482996.764842:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063995264 00000100:00100000:1.0:1788482996.764861:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063995264 00000100:00100000:1.0:1788482996.764955:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:1.0:1788482996.764969:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+33:10496:x1875360063995264:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:1.0:1788482996.765083:0:6958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788482996.765124:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad791f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b0a expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765156:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad791ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b03 expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765172:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077af5 expref: 31 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765187:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9231ebc00) 00010000:00010000:1.0:1788482996.765199:0:6958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788482996.765229:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765246:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765329:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765359:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765367:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765374:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765813:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765823:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.765830:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788482996.766619:0:6958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788482996.766634:0:6958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313932383894ns, next at 314932378424ns, rc = 0 00010000:00010000:2.0:1788482996.767211:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767227:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767237:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767247:0:6958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767286:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767292:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767313:0:6958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788482996.767343:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767349:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767356:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767363:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482996.767368:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767377:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767392:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3c00) 00010000:00010000:2.0:1788482996.767395:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788482996.767400:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767406:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad79214 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767427:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767441:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767448:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767453:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482996.767456:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767462:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767470:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:2.0:1788482996.767472:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482996.767476:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.767481:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79206 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.767818:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482996.767827:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.767833:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788482996.767838:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.767845:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.767856:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9eb9050b3c00) 00010000:00010000:1.0:1788482996.767859:0:8489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788482996.767862:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.767867:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7921b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.767886:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482996.767895:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482996.767897:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788482996.768601:0:6958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f86ed5ef reply state 00000000ac9c58c0 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482996.768617:0:6958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788482996.769093:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+32:10496:x1875360063995264:12345-192.168.201.6@tcp:36:rm.0 Request processed in 4116us (5129us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788482996.769105:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00010000:00010000:0.0:1788482996.775952:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.775983:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.775993:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.776000:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482996.776007:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.776056:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.776079:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9050b3b00) 00010000:00010000:0.0:1788482996.776083:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482996.776089:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482996.776097:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7920d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482996.875148:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482996.875653:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063995520 00000100:00100000:3.0:1788482996.875669:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063995520 00000100:00100000:3.0:1788482996.875754:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:3.0:1788482996.875768:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+31:10502:x1875360063995520:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788482996.875814:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482996.875842:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79222 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b11 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.876070:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.876090:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.876122:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.876141:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.876149:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.876156:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788482996.877589:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788482996.877850:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.877867:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.877879:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.877938:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.877948:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.877957:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.877965:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482996.877986:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.877996:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.878016:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482996.878021:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482996.878026:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.878033:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79229 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788482996.878052:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b1083ed reply state 00000000fe0339a5 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482996.878064:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788482996.878122:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79222 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 34 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.878140:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 33 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482996.878148:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb9231eb000) 00010000:00010000:3.0:1788482996.878151:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788482996.878154:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493600, rc 0) 00000100:00100000:3.0:1788482996.881551:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+34:10502:x1875360063995520:12345-192.168.201.6@tcp:101:bash.0 Request processed in 5761us (6395us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788482996.881570:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 96 00010000:00010000:2.0:1788482996.899705:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.899761:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.899771:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.899777:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482996.899794:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.899804:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.899829:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9231eb100) 00010000:00010000:2.0:1788482996.899832:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788482996.899838:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482996.899846:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79230 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482996.902766:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482996.903062:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063995648 00000100:00100000:1.0:1788482996.903077:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063995648 00000100:00100000:1.0:1788482996.903188:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1788482996.903202:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360063995648:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788482996.903227:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482996.903294:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b18 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788482996.903331:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:2.0:1788482996.903761:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788482996.903830:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:1.0:1788482996.903837:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482996.903853:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.903878:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.903898:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627a00, rc 0) 00000100:00100000:1.0:1788482996.904035:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063995648:12345-192.168.201.6@tcp:101:bash.0 Request processed in 834us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.904044:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:2.0:1788482996.915419:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482996.915584:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063995776 00000100:00100000:1.0:1788482996.915600:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063995776 00000100:00100000:1.0:1788482996.915679:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:1.0:1788482996.915692:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+6:10502:x1875360063995776:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788482996.915739:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482996.915765:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b1f expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.915826:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.915839:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482996.915846:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482996.915853:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.915905:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.915925:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 7 pid: 6660 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482996.915945:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6662:1875360072404992:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788482996.916217:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788482996.920846:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6662:1875360072404992:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482996.920902:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.920935:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626600, rc 0) 00000100:00100000:1.0:1788482996.921095:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:10502:x1875360063995776:12345-192.168.201.6@tcp:101:bash.0 Request processed in 5397us (5684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.921108:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:2.0:1788482996.934930:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482996.935557:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063995904 00000100:00100000:1.0:1788482996.935574:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063995904 00010000:00010000:1.0:1788482996.935635:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 7 pid: 6660 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482996.935845:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1788482996.935861:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360063995904:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788482996.935886:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482996.935922:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 7 pid: 6660 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.935942:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 7 pid: 6660 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.935976:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067214bcc/0x42820277aad79245 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b18 expref: 7 pid: 6660 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.936000:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482996.936018:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482996.936031:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.936044:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482996.936410:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482996.936433:0:5794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5794:1875360072405120:192.168.201.6@tcp:105: 00000100:00100000:1.0:1788482996.936559:0:5794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788482996.954863:0:5794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5794:1875360072405120:192.168.201.6@tcp:105: 00010000:00010000:1.0:1788482996.954904:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788482996.955005:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360063995904:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 19146us (20090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482996.955020:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:2.0:1788482996.956044:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482996.956489:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063996160 00000100:00100000:1.0:1788482996.956503:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063996160 00000100:00100000:1.0:1788482996.956569:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:1.0:1788482996.956582:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+33:10502:x1875360063996160:12345-192.168.201.6@tcp:35:bash.0 00000001:00080000:1.0:1788482996.956997:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000100:00100000:1.0:1788482996.957157:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+35:10502:x1875360063996160:12345-192.168.201.6@tcp:35:bash.0 Request processed in 577us (1120us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788482996.957168:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000020:00080000:1.0:1788482996.957174:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788482997.106661:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482997.193146:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.193848:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063996288 00000100:00100000:0.0:1788482997.193867:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063996288 00000100:00100000:0.0:1788482997.193960:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:0.0:1788482997.193976:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+35:10518:x1875360063996288:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788482997.194026:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482997.194063:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad79253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b26 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.194183:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad7925a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.194206:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad7925a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.194223:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad7925a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482997.194465:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788482997.194489:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788482997.194524:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad7925a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.194565:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad79253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b26 expref: 37 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.194591:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad7925a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b26 expref: 36 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.194605:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:0.0:1788482997.194609:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788482997.194614:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368e00, rc 0) 00000100:00100000:0.0:1788482997.194747:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+36:10518:x1875360063996288:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 773us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482997.194756:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:2.0:1788482997.212796:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.213844:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063996544 00000100:00100000:3.0:1788482997.213863:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063996544 00000100:00100000:3.0:1788482997.213950:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:3.0:1788482997.213965:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+36:10518:x1875360063996544:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482997.213998:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482997.214030:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79261 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.214182:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.214200:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.214215:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482997.214230:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788482997.214901:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79261 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b2d expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.214932:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b2d expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.214944:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb9231eb000) 00010000:00010000:3.0:1788482997.214947:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788482997.214953:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492a00, rc 0) 00000100:00100000:3.0:1788482997.215126:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+38:10518:x1875360063996544:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1163us (2355us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788482997.215165:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:3.0:1788482997.222307:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.222453:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063996672 00000100:00100000:0.0:1788482997.222474:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063996672 00000100:00100000:0.0:1788482997.222581:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1788482997.222601:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+38:2352:x1875360063996672:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482997.222624:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482997.222664:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b2d expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.222691:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb9231eb000) 00010000:00010000:0.0:1788482997.222698:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482997.222868:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+37:2352:x1875360063996672:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 273us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482997.222901:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1788482997.225821:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.231551:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063996928 00000100:00100000:0.0:1788482997.231569:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063996928 00000100:00100000:0.0:1788482997.231642:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:0.0:1788482997.231654:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+37:10518:x1875360063996928:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788482997.231685:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482997.231710:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad79276 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b34 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.231854:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad7927d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.231869:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad7927d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.231880:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad7927d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482997.231893:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788482997.232034:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad79276 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b34 expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.232054:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad7927d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b34 expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.232063:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb9231eb000) 00010000:00010000:0.0:1788482997.232066:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788482997.232069:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369400, rc 0) 00000100:00100000:0.0:1788482997.232162:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+39:10518:x1875360063996928:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 510us (6349us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788482997.232170:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:2.0:1788482997.237431:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.237734:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063997056 00000100:00100000:3.0:1788482997.237745:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063997056 00000100:00100000:3.0:1788482997.237812:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:3.0:1788482997.237823:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360063997056:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:3.0:1788482997.237872:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.237894:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.237901:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788482997.237906:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788482997.237910:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.237949:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.237965:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 6 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482997.237979:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921647b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1875360072405248:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482997.238080:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788482997.252969:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.253542:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063997184 00000100:00100000:3.0:1788482997.253554:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063997184 00002000:00100000:3.0:1788482997.253611:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9eb93a140380 x1875360063997184/t0(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:503/0 lens 504/0 e 0 to 0 dl 1788483008 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788482997.253624:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb93a140380 with x1875360063997184 ext(0->8) 00010000:00010000:3.0:1788482997.253636:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 7 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.253655:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 7 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788482997.253665:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eb93a140380 00000100:00100000:3.0:1788482997.253700:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788482997.253711:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360063997184:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:3.0:1788482997.256130:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa30c745-265d-4a44-8753-67e411452897+9:2351:x1875360063997184:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 2411us (3163us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788482997.256144:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00002000:00100000:3.0:1788482997.256160:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9eb93a140380 x1875360063997184/t4294967302(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:503/0 lens 504/448 e 0 to 0 dl 1788483008 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788482997.256169:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb93a140380 with x1875360063997184 ext(0->8) 00010000:00010000:3.0:1788482997.256179:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 9 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.256199:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 9 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788482997.256224:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eb93a140380 00000100:00100000:0.0:1788482997.257994:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921647b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1875360072405248:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482997.261279:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482997.264182:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.264276:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063997312 00000100:00100000:0.0:1788482997.264287:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063997312 00010000:00010000:0.0:1788482997.264328:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 9 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482997.264372:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1788482997.264391:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360063997312:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482997.264407:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788482997.264429:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788482997.264433:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788482997 00002000:00010000:0.0:1788482997.264435:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788482997 00002000:00010000:0.0:1788482997.264438:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788482997 00010000:00010000:0.0:1788482997.264444:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 9 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.264458:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 9 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.264481:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f245eb/0x42820277aad7924c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b1f expref: 9 pid: 6662 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.264511:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788482997.264516:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788482997.264523:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.264533:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.264558:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482997.264611:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360063997312:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 230us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482997.264619:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00010000:00010000:2.0:1788482997.264993:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.265004:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.265029:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.265038:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.265047:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.265054:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788482997.265059:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.265068:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.265084:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.265105:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad7928b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482997.265169:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360063997056:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 27348us (27749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.265177:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:2.0:1788482997.268362:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482997.268529:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063997568 00000100:00100000:1.0:1788482997.268541:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063997568 00000100:00100000:1.0:1788482997.268598:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1788482997.268609:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918889850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+39:10518:x1875360063997568:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:1.0:1788482997.268676:0:5810:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad7927d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b34 expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788482997.268998:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788482997.269039:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788482997.269687:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:1.0:1788482997.269747:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.269763:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 43 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.269772:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.269818:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 43 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.269835:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 43 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482997.269850:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1875360072405376:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788482997.269957:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788482997.273810:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482997.274237:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063997696 00000100:00100000:2.0:1788482997.274285:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063997696 00010000:00010000:2.0:1788482997.274342:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 44 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482997.274394:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:2.0:1788482997.274405:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+44:2352:x1875360063997696:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788482997.274427:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482997.274440:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 44 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.274461:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 44 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.274499:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb9231eb000) 00010000:00010000:2.0:1788482997.274508:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.274524:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.274557:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.274585:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482997.274661:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+44:2352:x1875360063997696:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 258us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.274669:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00010000:00010000:1.0:1788482997.276823:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b11 expref: 43 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482997.276850:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1875360072405376:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482997.277162:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.277200:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.277205:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788482997.277378:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1788482997.279300:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788482997.279516:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1875360072405504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788482997.279614:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482997.279683:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dde40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482997.283491:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072405504 00000100:00100000:2.0:1788482997.283518:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072405504 00000100:00100000:2.0:1788482997.283646:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788482997.283660:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875360072405504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788482997.283812:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875360072405504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 154us (4199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.283820:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788482997.284042:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1875360072405504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788482997.284830:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788482997.284921:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9071b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1875360072405632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788482997.284983:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482997.285015:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511780 going to sleep for 11 seconds 00000100:00100000:2.0:1788482997.286914:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072405632 00000100:00100000:2.0:1788482997.286936:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072405632 00000100:00100000:2.0:1788482997.287053:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788482997.287070:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875360072405632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788482997.287688:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5810:x1875360072405632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 619us (2700us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788482997.287704:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788482997.290090:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9071b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1875360072405632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788482997.290191:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788482997.290281:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.290292:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.290317:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.290515:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482997.290521:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.290530:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.290546:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb9231eb000) 00010000:00010000:0.0:1788482997.290550:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788482997.290555:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.290562:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad79292 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788482997.290788:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788482997.290887:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788482997.290898:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 314456648100ns, next at 315456646149ns, rc = 0 00000001:00080000:0.0:1788482997.290905:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788482997.290938:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb9231eb000) 00010000:00010000:0.0:1788482997.290942:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788482997.290950:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad7927d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b34 expref: 47 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482997.291081:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918889850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+46:10518:x1875360063997568:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 22472us (22728us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788482997.291102:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000020:00080000:0.0:1788482997.291108:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788482997.309903:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482997.309998:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063997824 00000100:00100000:2.0:1788482997.310018:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063997824 00000100:00100000:2.0:1788482997.310089:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:2.0:1788482997.310101:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+46:10518:x1875360063997824:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788482997.310127:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482997.310179:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b3b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.310320:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b3b expref: 47 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.310367:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b3b expref: 47 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.310843:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:2.0:1788482997.310850:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788482997.310855:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781a00, rc 0) 00000100:00100000:2.0:1788482997.310976:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+47:10518:x1875360063997824:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 872us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.310992:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:2.0:1788482997.314478:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482997.314548:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063998080 00000100:00100000:1.0:1788482997.314563:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063998080 00000100:00100000:1.0:1788482997.314635:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:1.0:1788482997.314647:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+47:10518:x1875360063998080:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482997.314949:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+48:10518:x1875360063998080:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 302us (1027us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788482997.314957:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:0.0:1788482997.414855:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.414955:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063998208 00000100:00100000:3.0:1788482997.414972:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063998208 00000100:00100000:3.0:1788482997.415076:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:3.0:1788482997.415090:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+48:10529:x1875360063998208:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1788482997.415210:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.415233:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.415294:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.415318:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.415483:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.415494:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.415625:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.415633:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.415640:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788482997.415710:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416749:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416762:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416769:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416785:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482997.416790:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416801:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416817:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482997.416821:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482997.416826:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416832:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416855:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416862:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416881:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416887:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482997.416890:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416896:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416904:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9231eb600) 00010000:00010000:3.0:1788482997.416907:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482997.416910:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416916:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416938:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416945:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416951:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416957:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482997.416960:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416978:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.416987:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788482997.416989:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482997.416992:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.417010:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482997.417442:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+48:10529:x1875360063998208:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 2347us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.417455:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:2.0:1788482997.469581:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.469691:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063998464 00000100:00100000:3.0:1788482997.469706:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063998464 00000100:00100000:3.0:1788482997.469844:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:3.0:1788482997.469857:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+48:10532:x1875360063998464:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482997.469884:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482997.469912:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b42 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470018:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470035:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470047:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470063:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470095:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470103:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470321:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470342:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470349:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482997.470362:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788482997.470485:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470494:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470502:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470508:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482997.470516:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470525:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470552:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482997.470555:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482997.470560:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470567:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad792bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470583:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470589:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470594:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470599:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482997.470602:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470609:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470616:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9231eb600) 00010000:00010000:3.0:1788482997.470618:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482997.470621:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.470627:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad792c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.473913:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad792b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.473957:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.473970:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:2.0:1788482997.473973:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788482997.474012:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492a00, rc 0) 00000100:00100000:2.0:1788482997.474116:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+50:10532:x1875360063998464:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 4260us (4549us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788482997.474128:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:0.0:1788482997.485154:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482997.485341:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063998592 00000100:00100000:2.0:1788482997.485355:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063998592 00000100:00100000:2.0:1788482997.485424:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:2.0:1788482997.485438:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+50:10532:x1875360063998592:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1788482997.485540:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485562:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485577:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485614:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485622:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485630:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485636:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482997.485641:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485651:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485690:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:2.0:1788482997.485693:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788482997.485699:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.485706:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad792d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482997.485826:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+50:10532:x1875360063998592:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 390us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.485835:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:3.0:1788482997.491585:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482997.491867:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063998848 00000100:00100000:1.0:1788482997.491883:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063998848 00000100:00100000:1.0:1788482997.492015:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1788482997.492031:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+50:10532:x1875360063998848:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788482997.492439:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+51:10532:x1875360063998848:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 408us (869us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788482997.492448:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1788482997.572714:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.576082:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063999104 00000100:00100000:0.0:1788482997.576106:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063999104 00000100:00100000:0.0:1788482997.576226:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:0.0:1788482997.576241:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+51:10542:x1875360063999104:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788482997.576292:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482997.576296:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788482997.576815:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad7925a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b26 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.576843:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:0.0:1788482997.576850:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788482997.576870:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad792df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.577073:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.577089:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.577099:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.577147:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.577188:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 51 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482997.577204:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9071b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072405760:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788482997.577893:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788482997.590935:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9071b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072405760:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482997.590984:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482997.593780:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.594037:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063999232 00000100:00100000:0.0:1788482997.594055:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063999232 00010000:00010000:0.0:1788482997.594127:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 52 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482997.594187:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1788482997.594198:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+52:2351:x1875360063999232:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482997.594217:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482997.594225:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 52 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.594241:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 52 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.594306:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad792ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b42 expref: 52 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.594609:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:0.0:1788482997.594616:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.594628:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.594638:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.594727:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482997.594822:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+51:2351:x1875360063999232:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 623us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482997.594832:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00010000:00010000:3.0:1788482997.596559:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.596579:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482997.596793:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788482997.598829:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad792df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 52 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.598875:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 51 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.598887:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:2.0:1788482997.598890:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788482997.598894:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368800, rc 0) 00000100:00100000:2.0:1788482997.599134:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+51:10542:x1875360063999104:12345-192.168.201.6@tcp:101:bash.0 Request processed in 22893us (26434us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788482997.599148:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:1.0:1788482997.605525:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.605658:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063999488 00000100:00100000:0.0:1788482997.605892:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063999488 00000100:00100000:0.0:1788482997.605988:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:0.0:1788482997.606016:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+51:10542:x1875360063999488:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:0.0:1788482997.606939:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.606967:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.606984:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788482997.607131:0:6958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:0.0:1788482997.607163:0:6958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029c16fa9 reply state 000000007300a91e transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482997.607185:0:6958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788482997.607939:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+54:10542:x1875360063999488:12345-192.168.201.6@tcp:36:bash.0 Request processed in 1920us (2424us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788482997.607952:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 105 00000020:00080000:1.0:1788482997.607960:0:6958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788482997.611236:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:3.0:1788482997.611356:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.611373:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.611383:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.611390:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482997.611395:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.611404:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.611426:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788482997.611430:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482997.611435:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.611442:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad792f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482997.611559:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063999616 00000100:00100000:1.0:1788482997.611576:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063999616 00000100:00100000:1.0:1788482997.611663:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:1.0:1788482997.611686:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+53:10542:x1875360063999616:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788482997.611728:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482997.611753:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad792fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b50 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.611871:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.611886:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.611896:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.611943:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.611959:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 54 pid: 5807 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482997.611989:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908703800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072405888:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788482997.613372:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788482997.617910:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.618019:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360063999744 00000100:00100000:3.0:1788482997.618034:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360063999744 00010000:00010000:3.0:1788482997.618101:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 55 pid: 5807 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482997.618210:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:3.0:1788482997.618223:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+55:2352:x1875360063999744:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482997.618244:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482997.618283:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 55 pid: 5807 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.618299:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 55 pid: 5807 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.618337:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788482997.618344:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.618354:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.618363:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.618389:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482997.618469:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+55:2352:x1875360063999744:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 247us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482997.618479:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00010000:00010000:1.0:1788482997.620133:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368800/0x42820277aad792e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b49 expref: 54 pid: 5807 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482997.620192:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908703800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072405888:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482997.620236:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.620267:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.620276:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482997.620553:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788482997.620561:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482997.620596:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.620647:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad792fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.620668:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 53 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.620679:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:1.0:1788482997.620704:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788482997.620723:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627200, rc 0) 00000100:00100000:1.0:1788482997.620861:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+53:10542:x1875360063999616:12345-192.168.201.6@tcp:101:bash.0 Request processed in 9176us (9638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482997.620872:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:2.0:1788482997.625464:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.625566:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064000000 00000100:00100000:0.0:1788482997.625582:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064000000 00000100:00100000:0.0:1788482997.625658:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:0.0:1788482997.625671:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+53:10542:x1875360064000000:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:0.0:1788482997.626138:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+54:10542:x1875360064000000:12345-192.168.201.6@tcp:35:bash.0 Request processed in 467us (812us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788482997.626147:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:1.0:1788482997.683572:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788482997.683606:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072406016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788482997.683725:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482997.684129:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072406016 00000100:00100000:3.0:1788482997.684142:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072406016 00000100:00100000:3.0:1788482997.684225:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788482997.684239:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072406016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788482997.684313:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788482997.684395:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072406016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482997.684403:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788482997.684570:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072406016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788482997.697597:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482997.697902:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064000128 00000100:00100000:1.0:1788482997.697918:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064000128 00000100:00100000:1.0:1788482997.698017:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:1.0:1788482997.698032:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+54:10548:x1875360064000128:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788482997.698067:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482997.698094:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79309 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b57 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.698204:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.698224:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.698238:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482997.698558:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1788482997.698563:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482997.698601:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.698679:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b57 expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.698985:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b57 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.699056:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:1.0:1788482997.699060:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788482997.699065:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626800, rc 0) 00000100:00100000:1.0:1788482997.699243:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+55:10548:x1875360064000128:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1212us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482997.699303:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:2.0:1788482997.704378:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.704543:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064000256 00000100:00100000:3.0:1788482997.704559:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064000256 00000100:00100000:3.0:1788482997.704643:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:3.0:1788482997.704657:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+55:10548:x1875360064000256:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788482997.704703:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788482997.704742:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.704841:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.704861:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.704876:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.704893:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.704901:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.704933:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705093:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7932c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705101:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7932c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705109:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7932c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788482997.705173:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788482997.705178:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788482997.705202:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7932c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705216:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7932c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705225:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705233:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705241:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705301:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482997.705307:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705330:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705346:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:3.0:1788482997.705349:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482997.705355:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705362:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad7931e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705378:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705384:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705391:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705396:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482997.705399:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705404:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705410:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb9231eb600) 00010000:00010000:3.0:1788482997.705412:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482997.705415:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705431:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705468:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b5e expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705480:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7932c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b5e expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.705487:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788482997.705490:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788482997.705492:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492a00, rc 0) 00000100:00100000:3.0:1788482997.705577:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+56:10548:x1875360064000256:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 922us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482997.705585:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:3.0:1788482997.710826:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.710971:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482997.711285:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064000640 00000100:00100000:2.0:1788482997.711300:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064000640 00000100:00100000:2.0:1788482997.711400:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:2.0:1788482997.711415:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+56:2354:x1875360064000640:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788482997.711436:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788482997.711471:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7932c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b5e expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.711495:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:2.0:1788482997.711501:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788482997.711573:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+55:2354:x1875360064000640:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 162us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.711582:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788482997.713811:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064000512 00000100:00100000:1.0:1788482997.713832:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064000512 00000100:00100000:1.0:1788482997.713968:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:1.0:1788482997.713984:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+55:10548:x1875360064000512:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788482997.714031:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482997.714064:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b65 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.714528:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.714551:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.714563:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.714628:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.714644:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 56 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482997.714671:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908701f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072406144:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788482997.715080:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788482997.719232:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.719957:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064000768 00000100:00100000:0.0:1788482997.719974:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064000768 00010000:00010000:0.0:1788482997.720038:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 57 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482997.720086:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:0.0:1788482997.720099:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+57:2352:x1875360064000768:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482997.720118:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482997.720126:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 57 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.720143:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 57 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.720184:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:0.0:1788482997.720191:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.720225:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.720234:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482997.720295:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482997.720524:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+57:2352:x1875360064000768:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 425us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482997.720532:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:0.0:1788482997.723632:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.723810:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482997.723910:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064001024 00000100:00100000:2.0:1788482997.723926:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064001024 00000100:00100000:2.0:1788482997.724021:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:2.0:1788482997.724036:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+8:2351:x1875360064001024:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482997.724133:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+8:2351:x1875360064001024:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 101us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.724141:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:0.0:1788482997.724441:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.724495:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482997.724543:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064000896 00000100:00100000:0.0:1788482997.724548:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064000896 00000100:00100000:0.0:1788482997.724583:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 291 00000100:00100000:0.0:1788482997.724591:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064000896:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788482997.724630:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064000896:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482997.724637:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 291 00000100:00100000:2.0:1788482997.724762:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064001152 00000100:00100000:2.0:1788482997.724766:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064001152 00000100:00100000:2.0:1788482997.724813:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:2.0:1788482997.724821:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064001152:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482997.724873:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064001152:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.724881:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00010000:00010000:1.0:1788482997.725160:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b50 expref: 56 pid: 5806 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482997.725186:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908701f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072406144:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482997.725217:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.725230:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.725238:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482997.725304:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788482997.725525:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.725544:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482997.725571:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:1.0:1788482997.725575:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788482997.725580:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626c00, rc 0) 00000100:00100000:1.0:1788482997.725624:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+56:10548:x1875360064000512:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 11645us (15385us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788482997.725631:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:1.0:1788482997.725653:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064001280 00000100:00100000:1.0:1788482997.725671:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064001280 00000100:00080000:2.0:1788482997.725937:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788482997.729550:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:2.0:1788482997.730618:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2351:x1875360064001280:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788482997.731164:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:2351:x1875360064001280:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 1590us (7348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.731180:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:2.0:1788482997.734637:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482997.735002:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064001536 00000100:00100000:3.0:1788482997.735020:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064001536 00000100:00100000:3.0:1788482997.735112:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788482997.735127:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+56:10548:x1875360064001536:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:3.0:1788482997.735153:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482997.735198:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b3b expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482997.735227:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788482997.735288:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482997.735502:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+55:10548:x1875360064001536:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 377us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482997.735510:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788482997.738464:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482997.738626:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064001664 00000100:00100000:2.0:1788482997.738639:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064001664 00000100:00100000:2.0:1788482997.738736:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:2.0:1788482997.738749:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+55:10548:x1875360064001664:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:2.0:1788482997.738940:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.738963:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.738979:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788482997.739355:0:6958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788482997.739473:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+55:10548:x1875360064001664:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 724us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.739482:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 110 00000100:00100000:0.0:1788482997.742974:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482997.743505:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064001792 00000100:00100000:2.0:1788482997.743537:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064001792 00000100:00100000:2.0:1788482997.743631:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 111 00000100:00100000:2.0:1788482997.743644:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+55:10548:x1875360064001792:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788482997.743682:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482997.743714:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b6c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.743814:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.743827:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b6c expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.743853:0:5809:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.743866:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b6c expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.743882:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:2.0:1788482997.743885:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788482997.743890:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b6c expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482997.743899:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780c00, rc 0) 00000100:00100000:2.0:1788482997.743975:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+56:10548:x1875360064001792:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 334us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482997.743982:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 111 00010000:00010000:2.0:1788482998.130583:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788482998.578537:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788482998.578546:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788482998.578587:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788482998.578595:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788482998.578741:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f163100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072406272:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788482998.579621:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788482998.596404:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482998.597068:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f163100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072406272:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788482998.597349:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064001920 00000100:00100000:2.0:1788482998.597356:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064001920 00000100:00100000:2.0:1788482998.597418:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:2.0:1788482998.597426:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+56:10549:x1875360064001920:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788482998.597455:0:6958:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788482998.597554:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+56:10549:x1875360064001920:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 129us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788482998.597560:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00080000:0.0:1788482998.598131:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788482998.614132:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.614310:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064002048 00000100:00100000:1.0:1788482998.614323:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064002048 00000100:00100000:1.0:1788482998.614413:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:1.0:1788482998.614425:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+56:10549:x1875360064002048:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788482998.614504:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614521:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614534:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614602:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614610:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614617:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614671:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614681:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614688:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482998.614734:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788482998.614738:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482998.614751:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614774:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614782:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614789:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614795:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482998.614800:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614808:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614820:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:1.0:1788482998.614831:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482998.614836:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614842:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79356 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614858:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614864:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614870:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614876:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482998.614879:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614885:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614892:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9eb9050b3300) 00010000:00010000:1.0:1788482998.614894:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482998.614897:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614901:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7935d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614916:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614927:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614933:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614938:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482998.614941:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614948:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614955:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:1.0:1788482998.614958:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482998.614961:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.614966:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482998.615121:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+56:10549:x1875360064002048:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 695us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.615130:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:3.0:1788482998.631693:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482998.631914:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064002304 00000100:00100000:2.0:1788482998.631927:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064002304 00000100:00100000:2.0:1788482998.632208:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:2.0:1788482998.632224:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+56:10549:x1875360064002304:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788482998.632295:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482998.632328:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7936b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b73 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632481:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632502:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632516:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788482998.632528:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788482998.632674:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632716:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632722:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632728:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482998.632734:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632741:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632765:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:2.0:1788482998.632768:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788482998.632772:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632777:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad79372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632822:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7936b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b73 expref: 58 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632833:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:2.0:1788482998.632835:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788482998.632839:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7936b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b73 expref: 58 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.632850:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781000, rc 0) 00000100:00100000:2.0:1788482998.632936:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+57:10549:x1875360064002304:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 716us (1258us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1788482998.632945:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:0.0:1788482998.637605:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.637716:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064002432 00000100:00100000:1.0:1788482998.637727:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064002432 00000100:00100000:1.0:1788482998.637819:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:1.0:1788482998.637831:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+57:10549:x1875360064002432:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788482998.637870:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788482998.638008:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+57:10549:x1875360064002432:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 178us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.638016:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:3.0:1788482998.641067:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482998.641118:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064002688 00000100:00100000:2.0:1788482998.641129:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064002688 00000100:00100000:2.0:1788482998.641200:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:2.0:1788482998.641211:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+57:10549:x1875360064002688:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788482998.641234:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482998.641238:0:6958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788482998.641291:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b57 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.641310:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:2.0:1788482998.641315:0:6958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788482998.641330:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79380 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b7a expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788482998.641794:0:6958:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788482998.645454:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.645487:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.645505:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.645629:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781a00/0x42820277aad79380 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b7a expref: 59 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.645696:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b7a expref: 58 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.645712:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb911fa9c00) 00010000:00010000:2.0:1788482998.645718:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788482998.645723:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67c00, rc 0) 00000100:00100000:2.0:1788482998.645852:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+58:10549:x1875360064002688:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 4639us (4791us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788482998.645868:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:3.0:1788482998.668834:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.668962:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064002944 00000100:00100000:1.0:1788482998.668983:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064002944 00000100:00100000:1.0:1788482998.669055:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:1.0:1788482998.669067:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+58:10549:x1875360064002944:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788482998.669133:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482998.669162:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b7a expref: 58 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669182:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb911fa9c00) 00010000:00010000:1.0:1788482998.669193:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788482998.669214:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669227:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669237:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669340:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669349:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669355:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669450:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669457:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669463:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669469:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482998.669473:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669479:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669487:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:1.0:1788482998.669489:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482998.669493:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669498:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79395 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669507:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669512:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669516:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669529:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482998.669532:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669538:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669547:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1227660a (ffff9eb9050b3300) 00010000:00010000:1.0:1788482998.669549:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482998.669552:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.669558:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7939c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1227660a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482998.669648:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+57:10549:x1875360064002944:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 583us (825us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788482998.669655:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:0.0:1788482998.674851:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.676284:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064003072 00000100:00100000:1.0:1788482998.676300:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064003072 00000100:00100000:1.0:1788482998.676367:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:1.0:1788482998.676378:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+57:10549:x1875360064003072:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788482998.676397:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482998.676420:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b81 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.676455:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.676486:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.676498:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.676591:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 59 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.676609:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 58 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.676618:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788482998.676621:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788482998.676624:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627a00, rc 0) 00000100:00100000:1.0:1788482998.676697:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+58:10549:x1875360064003072:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 320us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.676704:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:2.0:1788482998.681400:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482998.681489:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064003328 00000100:00100000:0.0:1788482998.681512:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064003328 00000100:00100000:0.0:1788482998.681585:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:0.0:1788482998.681596:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+58:10549:x1875360064003328:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788482998.681722:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.681741:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.681764:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788482998.682138:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788482998.682159:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315847907289ns, next at 316847902286ns, rc = 0 00000004:00010000:0.0:1788482998.682324:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8fa95c5 reply state 000000002cd5cc80 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482998.682335:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788482998.682486:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+60:10549:x1875360064003328:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 884us (1091us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788482998.682498:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00010000:00010000:2.0:1788482998.695880:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.695903:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.695910:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.695916:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788482998.695922:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.695930:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.695959:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:2.0:1788482998.695963:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788482998.696089:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.696096:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad793b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482998.702150:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.702333:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064003456 00000100:00100000:1.0:1788482998.702346:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064003456 00000100:00100000:1.0:1788482998.702418:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:1.0:1788482998.702429:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+59:10549:x1875360064003456:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788482998.702456:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482998.702480:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b88 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.702558:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 60 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.702592:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 60 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.702616:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788482998.702619:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788482998.702624:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627000, rc 0) 00000100:00100000:1.0:1788482998.702699:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+60:10549:x1875360064003456:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 272us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.702706:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:2.0:1788482998.712056:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482998.716531:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064003584 00000100:00100000:0.0:1788482998.716551:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064003584 00000100:00100000:0.0:1788482998.717304:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:0.0:1788482998.717323:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064003584:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788482998.719785:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360064003584:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 2456us (7799us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788482998.719800:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00080000:2.0:1788482998.720063:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482998.729170:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482998.729287:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064003840 00000100:00100000:0.0:1788482998.729313:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064003840 00000100:00100000:0.0:1788482998.729431:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:0.0:1788482998.729443:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+60:10549:x1875360064003840:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788482998.729706:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+61:10549:x1875360064003840:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 265us (545us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788482998.729715:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:2.0:1788482998.742025:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.742188:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064004096 00000100:00100000:1.0:1788482998.742202:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064004096 00000100:00100000:1.0:1788482998.742314:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:1.0:1788482998.742325:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+61:10549:x1875360064004096:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788482998.742456:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+61:10549:x1875360064004096:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 132us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.742463:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:2.0:1788482998.753863:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.754947:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064004224 00000100:00100000:1.0:1788482998.754968:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064004224 00000100:00100000:1.0:1788482998.755085:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:1.0:1788482998.755099:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+61:10549:x1875360064004224:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788482998.755130:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788482998.755163:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b8f expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.755309:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.755347:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.755359:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788482998.755411:0:6958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788482998.755438:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.755475:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b8f expref: 63 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.755497:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b8f expref: 62 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.755507:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788482998.755510:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788482998.755513:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627400, rc 0) 00000100:00100000:1.0:1788482998.755598:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+62:10549:x1875360064004224:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 500us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.755606:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:3.0:1788482998.767474:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482998.767692:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064004352 00000100:00100000:0.0:1788482998.767704:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064004352 00000100:00100000:0.0:1788482998.767780:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:0.0:1788482998.767792:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360064004352:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788482998.767819:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482998.767844:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b96 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788482998.767877:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a15b6, blocks: 0x1 00010000:00010000:0.0:1788482998.767900:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1788482998.767906:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482998.767917:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 10 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.767935:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 10 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.767962:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369c00, rc 0) 00000100:00100000:0.0:1788482998.768032:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+10:2352:x1875360064004352:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 242us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482998.768063:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:2.0:1788482998.778966:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.779071:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064004608 00000100:00100000:1.0:1788482998.779082:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064004608 00000100:00100000:1.0:1788482998.779162:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:1.0:1788482998.779175:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+62:10549:x1875360064004608:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788482998.779424:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+62:10549:x1875360064004608:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 246us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482998.779469:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:2.0:1788482998.790924:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482998.807467:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064004736 00000100:00100000:0.0:1788482998.807493:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064004736 00000100:00100000:0.0:1788482998.807653:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1788482998.807681:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+10:10549:x1875360064004736:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788482998.807718:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788482998.807765:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077b9d expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.807805:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 11 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.811543:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482998.811551:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788482998.811570:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 11 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.811671:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 11 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.811698:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 11 pid: 6662 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482998.811723:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1875360072406400:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788482998.822182:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482998.829650:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482998.829962:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1875360072406400:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482998.830200:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064004864 00000100:00100000:3.0:1788482998.830210:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064004864 00010000:00010000:3.0:1788482998.830292:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 12 pid: 6662 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482998.830408:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:3.0:1788482998.830421:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+12:2351:x1875360064004864:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482998.830440:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482998.830472:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 12 pid: 6662 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.830512:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 12 pid: 6662 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.830545:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002621609c/0x42820277aad793cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b96 expref: 12 pid: 6662 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.830562:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788482998.830567:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788482998.830575:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 11 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.830585:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 11 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.830625:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 11 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482998.830640:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f162300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5793:1875360072406528:192.168.201.6@tcp:105: 00000100:00100000:3.0:1788482998.830759:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788482998.831119:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 11 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482998.831132:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368000, rc 0) 00000100:00100000:0.0:1788482998.831171:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+11:10549:x1875360064004736:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 23504us (40264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482998.831181:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1788482998.840377:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482998.840478:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f162300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5793:1875360072406528:192.168.201.6@tcp:105: 00010000:00010000:3.0:1788482998.840511:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482998.840590:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+10:2351:x1875360064004864:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 10170us (10953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482998.840604:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:0.0:1788482998.840744:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064004992 00000100:00100000:0.0:1788482998.840765:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064004992 00002000:00100000:0.0:1788482998.840819:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9eb93f255500 x1875360064004992/t0(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:504/0 lens 504/0 e 0 to 0 dl 1788483009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788482998.840830:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb93f255500 with x1875360064004992 ext(0->12) 00002000:00010000:0.0:1788482998.840835:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb93f255500 00000100:00100000:0.0:1788482998.840878:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:0.0:1788482998.840888:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa30c745-265d-4a44-8753-67e411452897+10:2351:x1875360064004992:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788482998.841439:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa30c745-265d-4a44-8753-67e411452897+12:2351:x1875360064004992:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 551us (1069us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788482998.841447:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00002000:00100000:0.0:1788482998.841455:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9eb93f255500 x1875360064004992/t4294967308(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:504/0 lens 504/448 e 0 to 0 dl 1788483009 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788482998.841464:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb93f255500 with x1875360064004992 ext(0->12) 00002000:00010000:0.0:1788482998.841468:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb93f255500 00000100:00100000:2.0:1788482998.854589:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482998.854704:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064005120 00000100:00100000:0.0:1788482998.854737:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064005120 00000100:00100000:0.0:1788482998.854838:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:0.0:1788482998.854850:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+62:10549:x1875360064005120:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788482998.907429:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:3.0:1788482998.907456:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788482998.907476:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788482998.907494:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eb910e156c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788482998.907499:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb9063ed800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eb910e0a900 00000020:00080000:3.0:1788482998.907502:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb9063edb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eb93a037000 00000004:00080000:3.0:1788482998.907560:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788482998.907630:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eb904c28780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788482998.907634:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb93f7a7100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eb904c28300 00000020:00080000:3.0:1788482998.907637:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb93f7a7000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eb937009400 00000100:00100000:3.0:1788482998.907839:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072406656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788482998.907928:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482998.908299:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788482998.908307:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072406784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788482998.908334:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788482998.908420:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072406656 00000100:00100000:2.0:1788482998.908429:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072406656 00000100:00100000:2.0:1788482998.908501:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072406784 00000100:00100000:2.0:1788482998.908505:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072406784 00000100:00100000:2.0:1788482998.908521:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788482998.908530:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072406656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788482998.908562:0:6662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788482998.908597:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.908631:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 11 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.908671:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788482998.908678:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788482998.908684:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.908724:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 11 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.908741:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 11 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482998.908765:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6662:1875360072406912:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482998.908844:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fe900 going to sleep for 11 seconds 00000020:00080000:1.0:1788482998.909355:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788482998.909538:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788482998.909565:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072407040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788482998.909609:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788482998.909646:0:6660:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788482998.909653:0:6660:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788482998.909774:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072407040 00000100:00100000:1.0:1788482998.909779:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072407040 00000100:00100000:1.0:1788482998.909888:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788482998.909901:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072406784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788482998.910518:0:12045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788482998.910524:0:12045:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788482998 00002000:00010000:1.0:1788482998.910527:0:12045:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788482998.910529:0:12045:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788482998 -> 1788482998 00002000:00010000:1.0:1788482998.910532:0:12045:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788482998.910605:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3277:x1875360072406784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 706us (2268us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788482998.910614:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788482998.910636:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788482998.910644:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072407040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788482998.910665:0:12045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788482998.910697:0:12045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9a15b5, atime: 0x6a9a15b5, ctime: 0x6a9a15b5, blocks: 0x1 00010000:00010000:1.0:1788482998.910704:0:12045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913724:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=316s v=(0 0) 00010000:00010000:1.0:1788482998.913729:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788482998.913736:0:12045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913764:0:12045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913775:0:12045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913782:0:12045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913809:0:12045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788482998.913831:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788482998.913835:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913840:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627200 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788482998.913844:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913850:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913873:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913877:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f729ee/0x42820277aad793e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.913900:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482998.913901:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788482998.913902:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482998.914626:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072407040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3979us (5012us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788482998.914634:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1788482998.914687:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb908701f80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788482998.914691:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072407040:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788482998.914856:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb93f160380/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788482998.914862:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072406784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788482998.914913:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+15:10549:x1875360064005120:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 60061us (60337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482998.914924:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00080000:3.0:1788482998.915020:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788482998.915026:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788482998.919946:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482998.920043:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482998.920185:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6662:1875360072406912:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482998.920224:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482998.920578:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064005248 00000100:00100000:3.0:1788482998.920587:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064005248 00010000:00010000:3.0:1788482998.920636:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 12 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482998.920669:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:3.0:1788482998.920679:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+12:2352:x1875360064005248:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482998.920707:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482998.920714:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 12 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920742:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 12 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920780:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7919d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077afc expref: 12 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920797:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788482998.920801:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788482998.920808:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920818:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920841:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482998.920895:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+11:2352:x1875360064005248:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 217us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482998.920902:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00010000:00010000:3.0:1788482998.920926:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920934:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920943:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920957:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482998.920973:0:6662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788482998.921551:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3277:x1875360072406656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13020us (13622us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788482998.921561:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1788482998.922201:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb93f162300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788482998.922211:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072406656:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788482998.922297:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064005376 00000100:00100000:3.0:1788482998.922305:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064005376 00010000:00010000:2.0:1788482998.922678:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482998.922697:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.922711:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66200 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788482998.922731:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.922743:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.922776:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.922785:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad793db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482998.922808:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482998.922810:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482998.922812:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788482998.930859:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:1.0:1788482998.930894:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+11:2352:x1875360064005376:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788482998.982944:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+11:2352:x1875360064005376:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 52053us (62883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482998.982963:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000001:00080000:2.0:1788482998.984327:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788482998.984360:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788482998.984374:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1788482998.992629:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482998.992744:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064005632 00000100:00100000:1.0:1788482998.992766:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064005632 00000100:00100000:1.0:1788482998.992836:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:1.0:1788482998.992847:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+15:10549:x1875360064005632:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788482998.992914:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788482998.992956:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b8f expref: 15 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.993153:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788482998.993159:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788482998.993201:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.993217:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482998.993229:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788482998.994400:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f3749ea reply state 0000000068fc063b transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482998.994583:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788482998.994869:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+16:10549:x1875360064005632:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 2020us (2250us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788482998.994879:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00010000:00010000:3.0:1788482999.003905:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.003930:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.003941:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.003948:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788482999.003953:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.003962:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.004098:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:3.0:1788482999.004102:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788482999.004106:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.004136:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad793e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482999.005068:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482999.005279:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064005760 00000100:00100000:1.0:1788482999.005291:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064005760 00000100:00100000:1.0:1788482999.005350:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788482999.005362:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064005760:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788482999.005662:0:12045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788482999.005667:0:12045:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788482998 -> 1788482997 00002000:00010000:1.0:1788482999.005669:0:12045:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788482997 00002000:00010000:1.0:1788482999.005672:0:12045:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788482998 -> 1788482997 00002000:00010000:1.0:1788482999.005674:0:12045:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788482999.005945:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064005760:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 584us (884us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788482999.005956:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1788482999.011158:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482999.011607:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064006016 00000100:00100000:1.0:1788482999.011621:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064006016 00000100:00100000:1.0:1788482999.011807:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:1.0:1788482999.011819:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+15:10549:x1875360064006016:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788482999.011914:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.011935:0:6958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.011945:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.012064:0:6958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.012080:0:6958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 15 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482999.012095:0:6958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908702a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072407168:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788482999.012236:0:6958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788482999.017491:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482999.017870:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064006144 00000100:00100000:3.0:1788482999.017882:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064006144 00010000:00010000:3.0:1788482999.017932:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 16 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482999.017986:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:3.0:1788482999.017995:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+16:2352:x1875360064006144:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482999.018009:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482999.018016:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 16 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.018032:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 16 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.018061:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:3.0:1788482999.018068:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.018080:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.018088:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.018112:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482999.018193:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+16:2352:x1875360064006144:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 198us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482999.018201:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00010000:00010000:1.0:1788482999.018392:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad793aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b81 expref: 15 pid: 5807 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482999.018412:0:6958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908702a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072407168:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788482999.018438:0:6958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018448:0:6958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018454:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018494:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018503:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018509:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018515:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482999.018520:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018527:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018537:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788482999.018541:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788482999.018545:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.018552:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad793f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482999.018596:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+14:10549:x1875360064006016:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 6780us (7451us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788482999.018604:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:2.0:1788482999.024552:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482999.024669:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064006272 00000100:00100000:3.0:1788482999.024694:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064006272 00000100:00100000:3.0:1788482999.024773:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1788482999.024788:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064006272:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788482999.024840:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.024865:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.024875:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788482999.024880:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788482999.024886:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.024936:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.024953:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 7 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482999.024979:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92e958a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1875360072407296:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788482999.025074:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071adb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788482999.029031:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482999.029318:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064006400 00000100:00100000:0.0:1788482999.029328:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064006400 00010000:00010000:0.0:1788482999.029370:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 8 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482999.029421:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:0.0:1788482999.029434:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064006400:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482999.029465:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482999.029493:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 8 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.029509:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 8 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.029535:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788482999.029539:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788482999.029546:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.029556:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.029580:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482999.029642:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064006400:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 210us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482999.029650:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00010000:00010000:3.0:1788482999.031169:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d27d723/0x42820277aad793d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b9d expref: 7 pid: 6663 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482999.031219:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92e958a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1875360072407296:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788482999.031246:0:6663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031275:0:6663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031283:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031315:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031323:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031332:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031340:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788482999.031344:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031352:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031380:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.031387:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067587042/0x42820277aad793f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482999.031480:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360064006272:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 6696us (6941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482999.031489:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:2.0:1788482999.039074:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482999.039194:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064006656 00000100:00100000:0.0:1788482999.039206:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064006656 00000100:00100000:0.0:1788482999.039296:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:0.0:1788482999.039308:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+14:10549:x1875360064006656:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788482999.039405:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.039427:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.039459:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.039763:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.039774:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 15 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.039782:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.039812:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 15 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.039827:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 15 pid: 6958 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482999.039841:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072407424:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788482999.039954:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9033e3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788482999.048833:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072407424:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482999.048880:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482999.053466:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788482999.053715:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064006784 00000100:00100000:3.0:1788482999.053728:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064006784 00010000:00010000:3.0:1788482999.053790:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 16 pid: 6958 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788482999.053833:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1788482999.053844:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+16:2351:x1875360064006784:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788482999.053864:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788482999.053874:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 16 pid: 6958 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.053890:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 16 pid: 6958 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.053917:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad793b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b88 expref: 16 pid: 6958 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.053957:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:3.0:1788482999.053963:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.053984:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.053992:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788482999.054026:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788482999.054098:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+15:2351:x1875360064006784:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 256us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788482999.054107:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00010000:00010000:0.0:1788482999.054469:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.054479:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788482999.054727:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788482999.054903:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788482999.054954:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788482999.055064:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1875360072407552:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788482999.055130:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788482999.055176:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788482999.055313:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072407552 00000100:00100000:1.0:1788482999.055320:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072407552 00000100:00100000:1.0:1788482999.055367:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788482999.055386:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1875360072407552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788482999.055464:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1875360072407552:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482999.055472:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788482999.055779:0:5809:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788482999.055787:0:5809:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1788482999.055814:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb93f160380, transno 4294967309 00000004:00080000:3.0:1788482999.055833:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb93f162300, transno 4294967310 00000100:00100000:3.0:1788482999.055842:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1875360072407552:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788482999.056389:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788482999.056466:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92e958a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1875360072407680:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788482999.056508:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788482999.056541:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788482999.056687:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072407680 00000100:00100000:1.0:1788482999.056694:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072407680 00000100:00100000:1.0:1788482999.056759:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788482999.056770:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1875360072407680:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788482999.056990:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1875360072407680:12345-0@lo:1000:mdt00_002.0 Request processed in 221us (480us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788482999.056998:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788482999.057044:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92e958a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1875360072407680:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788482999.057078:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057088:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057096:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057103:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482999.057108:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057116:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057132:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788482999.057144:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788482999.057151:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057157:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79405 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057192:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057198:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057203:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057207:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482999.057210:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057215:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057224:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:1.0:1788482999.057226:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788482999.057232:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b6c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057242:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b6c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057282:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b6c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.057317:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b6c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482999.057330:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908702a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072407808:192.168.201.6@tcp:105: 00000100:00100000:1.0:1788482999.057401:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788482999.063237:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908702a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072407808:192.168.201.6@tcp:105: 00010000:00010000:1.0:1788482999.063326:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063338:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781800/0x42820277aad79348 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063381:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063397:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063408:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063421:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063428:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063435:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063460:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482999.063464:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063470:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063483:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:1.0:1788482999.063486:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788482999.063490:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063495:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7940c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063506:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063512:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063518:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063523:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788482999.063526:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063532:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063552:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:1.0:1788482999.063555:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788482999.063557:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.063563:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad793fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788482999.063857:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+18:10549:x1875360064006656:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 24550us (24795us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1788482999.063869:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 127 00000020:00080000:1.0:1788482999.063875:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788482999.064186:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788482999.064192:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788482999.064723:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788482999.064732:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788482999.067563:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482999.067669:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064007040 00000100:00100000:1.0:1788482999.067690:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064007040 00000100:00100000:1.0:1788482999.067758:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:1.0:1788482999.067768:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+18:10549:x1875360064007040:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788482999.068635:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788482999.069190:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:1.0:1788482999.069242:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.069834:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.069846:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.069856:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.069881:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.069888:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788482999.069912:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788482999.070108:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+20:10549:x1875360064007040:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 2337us (2553us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788482999.070118:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000020:00080000:1.0:1788482999.070125:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788482999.071141:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788482999.071168:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.071177:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788482999.071182:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.071191:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.071210:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:2.0:1788482999.071213:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788482999.071218:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.071223:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79413 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.071245:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482999.071276:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788482999.071279:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788482999.072775:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482999.074026:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064007168 00000100:00100000:1.0:1788482999.074042:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064007168 00000100:00100000:1.0:1788482999.074117:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:1.0:1788482999.074130:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918889050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+20:10548:x1875360064007168:12345-192.168.201.6@tcp:49:lfs.0 00000100:00100000:1.0:1788482999.074325:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918889050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+20:10548:x1875360064007168:12345-192.168.201.6@tcp:49:lfs.0 Request processed in 197us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482999.074333:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1788482999.077185:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482999.077539:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064007424 00000100:00100000:1.0:1788482999.077549:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064007424 00000100:00100000:1.0:1788482999.077602:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:1.0:1788482999.077612:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+20:10548:x1875360064007424:12345-192.168.201.6@tcp:58:lfs.0 00000040:00080000:1.0:1788482999.077868:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788482999.077948:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+20:10548:x1875360064007424:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 337us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788482999.077955:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 128 00000100:00100000:3.0:1788482999.116305:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788482999.116472:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064007552 00000100:00100000:2.0:1788482999.116485:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064007552 00000100:00100000:2.0:1788482999.116567:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:2.0:1788482999.116581:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+20:10551:x1875360064007552:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788482999.116610:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788482999.116636:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad7941a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ba4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.116741:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.116782:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.116796:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.116812:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.116819:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.116826:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.117158:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.117170:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.117179:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.117218:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788482999.117233:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 21 pid: 5809 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788482999.117300:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072407936:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788482999.117410:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fe840 going to sleep for 11 seconds 00000100:00100000:2.0:1788482999.121166:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788482999.121623:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064007808 00000100:00100000:1.0:1788482999.121634:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064007808 00000100:00100000:1.0:1788482999.122022:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:1.0:1788482999.122037:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+22:5592:x1875360064007808:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788482999.122315:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+23:5592:x1875360064007808:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 282us (1173us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788482999.124669:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788482999.124806:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072407936:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788482999.124844:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482999.124875:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064007936 00000100:00100000:0.0:1788482999.124885:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064007936 00010000:00010000:0.0:1788482999.124940:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 24 pid: 5809 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788482999.124994:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:0.0:1788482999.125007:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+24:2353:x1875360064007936:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788482999.125025:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788482999.125033:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 24 pid: 5809 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.125048:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 24 pid: 5809 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.125077:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad7933a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b65 expref: 24 pid: 5809 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.125126:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:0.0:1788482999.125132:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.125143:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.125152:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126024:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788482999.126093:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+23:2353:x1875360064007936:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 1085us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482999.126102:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00010000:00010000:0.0:1788482999.126179:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126187:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788482999.126242:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788482999.126246:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788482999.126281:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126295:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126305:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126327:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126334:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126339:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482999.126343:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126351:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126362:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:0.0:1788482999.126365:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482999.126368:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126374:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126388:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126394:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126399:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126404:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788482999.126413:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126419:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126427:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9eb911fa9200) 00010000:00010000:0.0:1788482999.126430:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788482999.126433:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126438:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126479:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad7941a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ba4 expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126494:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ba4 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788482999.126501:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:0.0:1788482999.126503:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788482999.126505:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67400, rc 0) 00000100:00100000:0.0:1788482999.126530:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+22:10551:x1875360064007552:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 9953us (10293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788482999.126538:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:1.0:1788482999.131663:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00010000:00010000:1.0:1788482999.154464:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788483000.114555:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788483000.114571:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483000.114619:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788483000.114627:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788483000.114849:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92e95bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072408064:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788483000.115051:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad240 going to sleep for 11 seconds 00000100:00100000:0.0:1788483000.126586:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92e95bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072408064:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788483000.127928:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483000.129329:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064008064 00000100:00100000:1.0:1788483000.129351:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064008064 00000100:00100000:1.0:1788483000.129473:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00080000:3.0:1788483000.129487:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483000.129489:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+21:10562:x1875360064008064:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788483000.129551:0:6958:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788483000.129750:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+21:10562:x1875360064008064:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 265us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483000.129758:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 130 00000100:00100000:3.0:1788483000.132331:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483000.132417:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064008320 00000100:00100000:1.0:1788483000.132433:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064008320 00000100:00100000:1.0:1788483000.132523:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:1.0:1788483000.132538:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+21:10562:x1875360064008320:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483000.132567:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483000.132595:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79436 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bab expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483000.132763:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7943d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483000.132803:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7943d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483000.132821:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7943d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483000.132838:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788483000.133182:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79436 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bab expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483000.133207:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7943d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bab expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483000.133217:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:1.0:1788483000.133220:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483000.133225:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627e00, rc 0) 00000100:00100000:3.0:1788483000.133555:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+23:10562:x1875360064008320:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1017us (1237us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788483000.133565:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 131 00000100:00100000:2.0:1788483000.139704:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483000.152008:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064008448 00000100:00100000:3.0:1788483000.152046:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064008448 00000100:00100000:3.0:1788483000.152267:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788483000.152282:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+23:2351:x1875360064008448:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483000.152302:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483000.152337:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad7943d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bab expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.152366:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788483000.152372:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483000.152464:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+22:2351:x1875360064008448:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 185us (12782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483000.152492:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1788483000.153324:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483000.158170:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064008704 00000100:00100000:3.0:1788483000.158199:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064008704 00000100:00100000:3.0:1788483000.158918:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 132 00000100:00100000:3.0:1788483000.158936:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+22:10562:x1875360064008704:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788483000.159125:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.159155:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.159172:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.160354:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.160372:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.160739:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.160751:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483000.160757:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.160767:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.160788:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788483000.160805:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788483000.160811:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.160818:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7944b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483000.161120:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+23:10562:x1875360064008704:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 2183us (7794us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788483000.161132:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 132 00000040:00080000:3.0:1788483000.161334:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788483000.161340:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788483000.162616:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788483000.162637:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483000.173441:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483000.177218:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064008960 00000100:00100000:2.0:1788483000.177262:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064008960 00000100:00100000:2.0:1788483000.177369:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:2.0:1788483000.177395:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+23:10562:x1875360064008960:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788483000.177809:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+24:10562:x1875360064008960:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 425us (4383us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788483000.177819:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00010000:00010000:2.0:1788483000.178632:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483000.305126:0:12083:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483000.305149:0:12083:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483000.305268:0:12083:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788483000.305277:0:12083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788483000.517620:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483000.517714:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064009216 00000100:00100000:3.0:1788483000.517745:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064009216 00000100:00100000:3.0:1788483000.517866:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:3.0:1788483000.517884:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+24:10575:x1875360064009216:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483000.517928:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483000.517979:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79452 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bb2 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.518160:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79459 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.518179:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.518195:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79459 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483000.518240:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788483000.518466:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad79452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bb2 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.528425:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79459 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bb2 expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.528449:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788483000.528453:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788483000.528457:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492e00, rc 0) 00000100:00100000:3.0:1788483000.528575:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+26:10575:x1875360064009216:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 10696us (10967us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788483000.528587:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 133 00000100:00100000:1.0:1788483000.547576:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483000.548170:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064009344 00000100:00100000:3.0:1788483000.548185:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064009344 00000100:00100000:3.0:1788483000.548281:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:3.0:1788483000.548295:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+26:10575:x1875360064009344:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1788483000.548390:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548412:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548424:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548458:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548479:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548486:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548493:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483000.548498:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548506:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548520:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:3.0:1788483000.548524:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483000.548529:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483000.548535:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79467 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483000.548636:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+26:10575:x1875360064009344:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 343us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483000.548646:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 134 00000100:00100000:2.0:1788483000.680124:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483000.680504:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064009472 00000100:00100000:0.0:1788483000.680519:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064009472 00000100:00080000:3.0:1788483000.680691:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483000.681594:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:0.0:1788483000.681621:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064009472:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1788483000.681646:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483000.681675:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6c2ed3a/0x42820277aad7946e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bb9 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483000.681711:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9a15b5, atime: 0x6a9a15b5, ctime: 0x6a9a15b5, blocks: 0xb 00010000:00010000:0.0:1788483000.681754:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=317s v=(0 0) 00010000:00010000:0.0:1788483000.681760:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483000.681773:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6c2ed3a/0x42820277aad7946e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bb9 expref: 7 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483000.681797:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6c2ed3a/0x42820277aad7946e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bb9 expref: 7 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483000.681814:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368800, rc 0) 00000100:00100000:0.0:1788483000.681912:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064009472:12345-192.168.201.6@tcp:101:cat.0 Request processed in 303us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483000.681920:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1788483000.688418:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483000.688619:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064009600 00000100:00100000:2.0:1788483000.688643:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064009600 00002000:00100000:2.0:1788483000.688742:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9eb921644e00 x1875360064009600/t0(0) o3->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:506/0 lens 488/0 e 0 to 0 dl 1788483011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483000.688757:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb921644e00 with x1875360064009600 ext(0->4095) 00002000:00010000:2.0:1788483000.688767:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb921644e00 00000100:00100000:2.0:1788483000.688813:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:2.0:1788483000.688824:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064009600:12345-192.168.201.6@tcp:3:cat.0 00000100:00100000:2.0:1788483000.689184:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064009600:12345-192.168.201.6@tcp:3:cat.0 Request processed in 359us (777us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788483000.689203:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00002000:00100000:2.0:1788483000.689211:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9eb921644e00 x1875360064009600/t0(0) o3->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:506/0 lens 488/4536 e 0 to 0 dl 1788483011 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788483000.689219:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb921644e00 with x1875360064009600 ext(0->4095) 00002000:00010000:2.0:1788483000.689223:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb921644e00 00010000:00010000:2.0:1788483001.202868:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483001.267016:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072408192:0@lo:400:kworker.0 00000100:00100000:1.0:1788483001.267156:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483001.267304:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072408192 00000100:00100000:1.0:1788483001.267316:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072408192 00000100:00100000:1.0:1788483001.267376:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788483001.267397:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072408192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483001.267459:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb90867e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072408192:12345-0@lo:400:kworker.0 Request processed in 63us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483001.267466:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788483001.267539:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072408192:0@lo:400:kworker.0 00000100:00100000:2.0:1788483001.268374:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072408320:0@lo:400:kworker.0 00000100:00100000:2.0:1788483001.268432:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483001.268478:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072408320 00000100:00100000:2.0:1788483001.268485:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072408320 00000100:00100000:2.0:1788483001.268533:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788483001.268744:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072408320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483001.274697:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072408448:0@lo:400:kworker.0 00000100:00100000:0.0:1788483001.275235:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072408320:12345-0@lo:400:kworker.0 Request processed in 6686us (6797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483001.275272:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788483001.275373:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072408320:0@lo:400:kworker.0 00000100:00100000:3.0:1788483001.277187:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483001.277292:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072408448 00000100:00100000:3.0:1788483001.277320:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072408448 00000100:00100000:3.0:1788483001.277400:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788483001.277415:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072408448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483001.277490:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072408448:12345-0@lo:400:kworker.0 Request processed in 79us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483001.277498:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788483001.277524:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483001.277566:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072408448:0@lo:400:kworker.0 00000100:00100000:3.0:1788483001.277688:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483001.277700:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072408832:0@lo:400:kworker.0 00000100:00100000:3.0:1788483001.277756:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483001.277878:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072408576:0@lo:400:kworker.0 00000100:00100000:1.0:1788483001.277924:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072408704:0@lo:400:kworker.0 00000100:00100000:1.0:1788483001.277951:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483001.278145:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072408704 00000100:00100000:0.0:1788483001.278152:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072408704 00000100:00100000:0.0:1788483001.278203:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788483001.278222:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072408704:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788483001.278334:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483001.278455:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483001.278485:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072408832 00000100:00100000:3.0:1788483001.278489:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072408832 00000100:00100000:0.0:1788483001.283938:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072408704:12345-0@lo:400:kworker.0 Request processed in 5702us (5970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483001.283962:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788483001.284193:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072408704:0@lo:400:kworker.0 00000100:00100000:3.0:1788483001.292233:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072408576 00000100:00100000:3.0:1788483001.292272:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072408576 00000100:00100000:2.0:1788483001.292911:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788483001.292939:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3278:x1875360072408832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483001.293089:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3278:x1875360072408832:12345-0@lo:400:kworker.0 Request processed in 166us (15331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483001.293098:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788483001.293126:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788483001.293135:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072408576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483001.293177:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072408576:12345-0@lo:400:kworker.0 Request processed in 44us (14722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483001.293184:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788483001.293245:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072408832:0@lo:400:kworker.0 00000100:00080000:2.0:1788483001.293326:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483001.293332:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788483001.293366:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072408576:0@lo:400:kworker.0 00000001:00080000:1.0:1788483001.357578:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788483001.358768:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788483001.778550:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483001.778587:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072408960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483001.778710:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483001.778831:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072408960 00000100:00100000:2.0:1788483001.778845:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072408960 00000100:00100000:2.0:1788483001.778932:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788483001.778947:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072408960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788483001.779016:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788483001.779079:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072408960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483001.779088:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788483001.779143:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788483001.779151:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788483001.779178:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb908701f80, transno 4294967304 00000100:00100000:2.0:1788483001.779200:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072408960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788483002.226818:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483002.802585:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072409088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483002.802700:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483002.802897:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072409088 00000100:00100000:0.0:1788483002.802909:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072409088 00000100:00100000:0.0:1788483002.802990:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788483002.803004:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072409088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483002.803059:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483002.805174:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072409088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2162us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483002.805188:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072409088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483002.805190:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788483002.844429:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483002.844462:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483002.844502:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483002.844538:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483002.844597:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483002.844630:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064010112 00000100:00100000:2.0:1788483002.844641:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064010112 00000100:00100000:2.0:1788483002.844725:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064009984 00000100:00100000:2.0:1788483002.844729:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064009984 00000100:00100000:2.0:1788483002.844756:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:2.0:1788483002.844765:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360064010112:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788483002.844862:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360064010112:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 97us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483002.844870:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:2.0:1788483002.844886:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:2.0:1788483002.844891:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064009984:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788483002.844912:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064009984:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 22us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483002.844916:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:2.0:1788483002.844929:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064009856 00000100:00100000:2.0:1788483002.844932:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064009856 00000100:00100000:2.0:1788483002.844960:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064010240 00000100:00100000:2.0:1788483002.844964:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064010240 00000100:00100000:2.0:1788483002.844982:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:2.0:1788483002.844988:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+26:2351:x1875360064009856:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788483002.845018:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+26:2351:x1875360064009856:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 31us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483002.845026:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:2.0:1788483002.845037:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 149 00000100:00100000:2.0:1788483002.845043:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2351:x1875360064010240:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788483002.845077:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2351:x1875360064010240:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 33us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483002.845084:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 149 00000100:00080000:2.0:1788483002.845101:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483002.845106:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483002.845108:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483002.845453:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064009728 00000100:00100000:1.0:1788483002.845458:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064009728 00000100:00100000:1.0:1788483002.845492:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 293 00000100:00100000:1.0:1788483002.845500:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064009728:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483002.845545:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064009728:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 46us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483002.845551:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 293 00010000:00010000:0.0:1788483003.258812:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483004.275308:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483004.275323:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483004.275370:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788483004.275379:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788483004.275654:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788483004.403358:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000001:00080000:3.0:1788483004.403390:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:3.0:1788483004.403410:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1788483004.403429:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:00080000:3.0:1788483004.403436:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788483004.403450:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eb9071adcc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788483004.403456:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb939e03c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eb9071adb40 00000020:00080000:3.0:1788483004.403461:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb939e03e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eb93f356400 00000020:00080000:1.0:1788483004.403899:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788483004.406186:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1788483004.448296:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1788483004.448343:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:1.0:1788483005.298397:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483005.805711:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483005.806096:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064010368 00000100:00100000:3.0:1788483005.806112:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064010368 00000100:00100000:3.0:1788483005.806311:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00100000:3.0:1788483005.806328:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+13:10228:x1875360064010368:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788483005.806529:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+13:10228:x1875360064010368:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 Request processed in 206us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483005.806539:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 135 00000100:00080000:2.0:1788483005.807356:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483005.809758:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483005.809813:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064010624 00000100:00100000:3.0:1788483005.809826:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064010624 00000100:00100000:3.0:1788483005.809904:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:3.0:1788483005.809918:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+13:10228:x1875360064010624:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788483005.811407:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+14:10228:x1875360064010624:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1480us (1653us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788483005.811421:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:0.0:1788483006.052778:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483006.052904:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064010752 00000100:00100000:3.0:1788483006.052918:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064010752 00000100:00100000:3.0:1788483006.053108:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00100000:3.0:1788483006.053122:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+5:11027:x1875360064010752:12345-192.168.201.6@tcp:101:lsof.0 00010000:00010000:3.0:1788483006.053151:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483006.053194:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bc0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.053317:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.053334:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.053351:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483006.053719:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788483006.053723:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483006.053839:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.053874:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.053898:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483006.053908:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483006.053911:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483006.053915:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493600, rc 0) 00000100:00100000:3.0:1788483006.054018:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5778eeb0-8512-44ab-a78a-f60f28116302+6:11027:x1875360064010752:12345-192.168.201.6@tcp:101:lsof.0 Request processed in 898us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483006.054026:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 136 00000100:00080000:2.0:1788483006.054397:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788483006.323100:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483006.386897:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072409600:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387054:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483006.387149:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788483006.387156:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072409216:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387189:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483006.387209:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb908701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072409728:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387232:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483006.387286:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072409344:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387312:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483006.387333:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9071b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072409856:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387398:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483006.387420:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483006.387427:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072409472:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387450:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483006.387487:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072409600 00000100:00100000:2.0:1788483006.387497:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072409600 00000100:00100000:2.0:1788483006.387573:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072409856 00000100:00100000:2.0:1788483006.387578:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072409856 00000100:00100000:2.0:1788483006.387603:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788483006.387614:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072409600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387686:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072409600:12345-0@lo:400:kworker.0 Request processed in 73us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483006.387694:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788483006.387715:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788483006.387721:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072409856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387750:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072409856:12345-0@lo:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483006.387756:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788483006.387798:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9071b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072409856:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387823:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788483006.387829:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788483006.387846:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072409600:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387865:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072409728 00000100:00100000:2.0:1788483006.387869:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072409728 00000100:00100000:2.0:1788483006.387897:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072409344 00000100:00100000:2.0:1788483006.387900:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072409344 00000100:00100000:2.0:1788483006.387909:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072409472 00000100:00100000:2.0:1788483006.387912:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072409472 00000100:00100000:2.0:1788483006.387924:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788483006.387930:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072409728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.387966:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072409728:12345-0@lo:400:kworker.0 Request processed in 36us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483006.387972:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788483006.387993:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788483006.387999:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072409344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.388034:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072409344:12345-0@lo:400:kworker.0 Request processed in 36us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483006.388040:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788483006.388053:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788483006.388059:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072409472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.388083:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072409472:12345-0@lo:400:kworker.0 Request processed in 25us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483006.388088:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788483006.388111:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072409472:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.388121:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072409344:0@lo:400:kworker.0 00000100:00100000:2.0:1788483006.388141:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb908701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072409728:0@lo:400:kworker.0 00000100:00080000:2.0:1788483006.388156:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483006.388162:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483006.388164:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483006.388508:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072409216 00000100:00100000:1.0:1788483006.388513:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072409216 00000100:00100000:1.0:1788483006.388567:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788483006.388576:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483006.388640:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072409216:12345-0@lo:400:kworker.0 Request processed in 66us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483006.388646:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788483006.388782:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072409216:0@lo:400:kworker.0 00000100:00100000:3.0:1788483006.898583:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072409984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483006.898707:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483006.898880:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072409984 00000100:00100000:2.0:1788483006.898892:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072409984 00000100:00100000:2.0:1788483006.898963:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788483006.898974:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9059da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072409984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788483006.899021:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788483006.899082:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9059da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072409984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483006.899090:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788483006.899401:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072409984:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788483007.346592:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483007.924393:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072410112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483007.924493:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483007.924624:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072410112 00000100:00100000:2.0:1788483007.924636:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072410112 00000100:00100000:2.0:1788483007.924696:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788483007.924707:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072410112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483007.924754:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788483007.924969:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072410112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 262us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483007.924977:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788483007.925107:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072410112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483007.963559:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483007.963633:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483007.963678:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483007.963706:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483007.963735:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483007.963771:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064011392 00000100:00100000:2.0:1788483007.963784:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064011392 00000100:00100000:2.0:1788483007.963848:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064011008 00000100:00100000:2.0:1788483007.963852:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064011008 00000100:00100000:2.0:1788483007.963886:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:2.0:1788483007.963898:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+6:2351:x1875360064011392:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483007.964032:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064011136 00000100:00100000:1.0:1788483007.964038:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064011136 00000100:00100000:1.0:1788483007.964079:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064011264 00000100:00100000:1.0:1788483007.964082:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064011264 00000100:00100000:1.0:1788483007.964109:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:1.0:1788483007.964119:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360064011136:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483007.964195:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064010880 00000100:00100000:3.0:1788483007.964202:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064010880 00000100:00100000:1.0:1788483007.964207:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360064011136:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483007.964217:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:3.0:1788483007.964246:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 295 00000100:00100000:1.0:1788483007.964287:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:3.0:1788483007.964294:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064010880:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483007.964301:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360064011264:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483007.964333:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064010880:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 44us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483007.964339:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360064011264:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 40us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483007.964345:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 89 00000100:00100000:3.0:1788483007.964368:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 295 00000100:00100000:1.0:1788483007.964373:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 154 00000100:00100000:1.0:1788483007.964383:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+14:2351:x1875360064011008:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483007.964421:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+14:2351:x1875360064011008:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 40us (714us total) trans 0 rc 0/0 00000100:00080000:3.0:1788483007.964422:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483007.964428:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483007.964433:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483007.964442:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 154 00000100:00100000:2.0:1788483007.964641:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+6:2351:x1875360064011392:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 743us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483007.964652:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 153 00010000:00010000:3.0:1788483008.370609:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788483008.978232:0:12285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:50:07 (1788483007) 00010000:00010000:0.0:1788483009.394607:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788483009.514104:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788483009.514143:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788483009.514232:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788483009.514274:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788483010.200675:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483010.200956:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064011648 00000100:00100000:2.0:1788483010.200971:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064011648 00000100:00100000:2.0:1788483010.201068:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:2.0:1788483010.201081:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+13:11293:x1875360064011648:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483010.201107:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483010.201134:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79483 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bc7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.201246:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.201309:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.201341:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.201361:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.201369:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.201375:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202089:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67600/0x42820277aad79498 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202101:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67600/0x42820277aad79498 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202118:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67600/0x42820277aad79498 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483010.202131:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788483010.202744:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202756:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202765:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202771:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483010.202840:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202851:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202869:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eb911fa9f00) 00010000:00010000:2.0:1788483010.202873:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483010.202879:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202885:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7948a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202901:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202907:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202921:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202926:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483010.202929:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202934:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202942:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eb911fa9300) 00010000:00010000:2.0:1788483010.202944:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483010.202947:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.202952:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79491 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788483010.203668:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788483010.204245:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79483 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc7 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.204299:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67600/0x42820277aad79498 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc7 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483010.204309:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:2.0:1788483010.204312:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483010.204327:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67600, rc 0) 00000100:00100000:2.0:1788483010.204440:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+15:11293:x1875360064011648:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 3360us (3780us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788483010.204463:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 137 00000100:00100000:1.0:1788483010.212862:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483010.213239:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064011904 00000100:00100000:0.0:1788483010.213285:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064011904 00000100:00100000:0.0:1788483010.213367:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:0.0:1788483010.213381:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+15:11293:x1875360064011904:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788483010.213537:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+15:11293:x1875360064011904:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 159us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483010.213546:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 138 00000100:00100000:0.0:1788483010.231134:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483010.232520:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064011776 00000100:00100000:3.0:1788483010.232539:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064011776 00000100:00100000:3.0:1788483010.232654:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788483010.232668:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+15:2352:x1875360064011776:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483010.232688:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483010.232723:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67600/0x42820277aad79498 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc7 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483010.232751:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:3.0:1788483010.232757:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483010.232957:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+14:2352:x1875360064011776:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 290us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483010.232967:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000040:00080000:0.0:1788483010.419931:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788483010.419941:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483010.421119:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788483010.421134:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788483010.422371:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483011.442745:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483011.506789:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072410368:0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.506897:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483011.507009:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072410880:0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.507052:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483011.507232:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072410240:0@lo:400:kworker.0 00000100:00100000:2.0:1788483011.507343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483011.507832:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483011.507844:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072410496:0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.507885:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483011.507986:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072410368 00000100:00100000:3.0:1788483011.507997:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072410368 00000100:00100000:3.0:1788483011.508112:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072410496 00000100:00100000:3.0:1788483011.508116:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072410496 00000100:00100000:3.0:1788483011.508216:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788483011.508227:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072410368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.508629:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072410368:12345-0@lo:400:kworker.0 Request processed in 403us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483011.508638:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788483011.508661:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788483011.508668:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072410496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.508694:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072410496:12345-0@lo:400:kworker.0 Request processed in 27us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483011.508700:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1788483011.508722:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483011.508827:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072410496:0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.508844:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072410368:0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.508902:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072410624:0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.508990:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483011.509083:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072410880 00000100:00100000:3.0:1788483011.509088:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072410880 00000100:00100000:3.0:1788483011.509121:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072410624 00000100:00100000:3.0:1788483011.509123:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072410624 00000100:00100000:3.0:1788483011.509204:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788483011.509224:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072410880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.509579:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072410880:12345-0@lo:400:kworker.0 Request processed in 356us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483011.509587:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788483011.509606:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788483011.509614:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072410624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.509650:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072410624:12345-0@lo:400:kworker.0 Request processed in 38us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483011.509657:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788483011.509676:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483011.509679:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483011.509713:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072410624:0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.509739:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072410880:0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.509841:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072410240 00000100:00100000:3.0:1788483011.509847:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072410240 00000100:00100000:3.0:1788483011.509878:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788483011.509885:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072410240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483011.509920:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072410240:12345-0@lo:400:kworker.0 Request processed in 37us (2579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483011.509987:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788483011.512369:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072410240:0@lo:400:kworker.0 00000100:00100000:2.0:1788483011.512392:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072410752:0@lo:400:kworker.0 00000100:00100000:2.0:1788483011.512476:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483011.513345:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072410752 00000100:00100000:1.0:1788483011.513355:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072410752 00000100:00100000:1.0:1788483011.513415:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788483011.513425:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072410752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483011.513492:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072410752:12345-0@lo:400:kworker.0 Request processed in 68us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483011.513500:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1788483011.513546:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483011.514121:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072410752:0@lo:400:kworker.0 00000100:00100000:0.0:1788483012.022392:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072411008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483012.022492:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483012.024365:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072411008 00000100:00100000:2.0:1788483012.024377:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072411008 00000100:00100000:2.0:1788483012.024437:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788483012.024447:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072411008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788483012.024489:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788483012.024570:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072411008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483012.024577:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788483012.030831:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072411008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483012.408130:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.415592:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064012032 00000100:00100000:3.0:1788483012.415609:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064012032 00000100:00080000:2.0:1788483012.415663:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483012.415726:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:2.0:1788483012.415739:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+14:11335:x1875360064012032:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483012.415762:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483012.415787:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad794a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bce expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.415863:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.415892:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.415905:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.415934:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.415942:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.415948:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416231:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416239:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416246:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416289:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483012.416294:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416300:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416313:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:2.0:1788483012.416321:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483012.416326:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416332:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad794ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416345:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416350:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416356:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416361:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483012.416364:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416369:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416376:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eb911fa9300) 00010000:00010000:2.0:1788483012.416379:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483012.416382:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416387:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad794b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416419:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad794a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bce expref: 15 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416440:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:2.0:1788483012.416443:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483012.416448:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad794a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bce expref: 15 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.416458:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67c00, rc 0) 00000100:00100000:2.0:1788483012.416569:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+14:11335:x1875360064012032:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 832us (8448us total) trans 0 rc 301/301 00000100:00100000:2.0:1788483012.416577:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 139 00000100:00100000:1.0:1788483012.422622:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.422818:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064012288 00000100:00100000:3.0:1788483012.422830:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064012288 00000100:00100000:3.0:1788483012.422903:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 140 00000100:00100000:3.0:1788483012.422914:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+14:11335:x1875360064012288:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:3.0:1788483012.422992:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483012.423039:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad78e24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a07 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.423060:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483012.423066:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483012.423373:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.423388:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 5 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.423397:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.423438:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 5 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.423457:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 5 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483012.423475:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072411136:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483012.423729:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903069d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483012.427473:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.427553:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064012416 00000100:00100000:3.0:1788483012.427565:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064012416 00000100:00080000:2.0:1788483012.427671:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788483012.427678:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 6 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483012.427729:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1788483012.427745:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5778eeb0-8512-44ab-a78a-f60f28116302+6:2351:x1875360064012416:12345-192.168.201.6@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788483012.427745:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072411136:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483012.427760:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483012.427767:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 6 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.427773:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.427779:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 6 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.429656:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad7947c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bc0 expref: 6 pid: 5807 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.429677:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483012.429682:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.429691:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.429698:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.429761:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483012.429825:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2351:x1875360064012416:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 2079us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483012.429834:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00010000:00010000:3.0:1788483012.431396:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.431413:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.431449:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.431462:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.431481:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483012.432818:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788483012.432835:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.432844:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.432851:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.432857:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483012.432862:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.432868:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.432887:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483012.432890:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483012.432896:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.432902:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483012.432932:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b94a8c3 reply state 0000000096351807 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483012.432956:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483012.433529:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+15:11335:x1875360064012288:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 10599us (10903us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788483012.433540:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 140 00010000:00010000:0.0:1788483012.440296:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.440320:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.440329:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.440336:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483012.440341:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.440348:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.440368:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eb9231eb500) 00010000:00010000:0.0:1788483012.440384:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483012.440390:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.440397:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad794c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.476239:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483012.509539:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.510405:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064012544 00000100:00100000:3.0:1788483012.510423:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064012544 00000100:00100000:3.0:1788483012.510509:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:3.0:1788483012.510531:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+14:11343:x1875360064012544:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:3.0:1788483012.510576:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483012.510603:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bd5 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.510688:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad794d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.510706:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad794d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.510717:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad794d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483012.510780:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788483012.510785:0:6958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483012.510810:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad794d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.510837:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bd5 expref: 16 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.510881:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad794d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bd5 expref: 15 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.510890:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483012.510893:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483012.510896:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493600, rc 0) 00000100:00100000:3.0:1788483012.510990:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+15:11343:x1875360064012544:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 461us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483012.511000:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 141 00000100:00100000:2.0:1788483012.581682:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483012.581845:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064012672 00000100:00100000:1.0:1788483012.581860:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064012672 00000100:00100000:1.0:1788483012.582042:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:1.0:1788483012.582060:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+15:11349:x1875360064012672:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788483012.584403:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483012.584447:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad794d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bdc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584533:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584548:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584560:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584575:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584582:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584588:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584711:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad794ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584740:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad794ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584746:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad794ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483012.584781:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1788483012.584784:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788483012.584805:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad794ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584817:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584823:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584830:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584837:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483012.584842:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584849:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584862:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:0.0:1788483012.584865:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483012.584869:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584885:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad794de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584899:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584905:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584923:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584929:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483012.584932:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584938:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584946:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9eb907174d00) 00010000:00010000:0.0:1788483012.584949:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483012.584952:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584957:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad794e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.584994:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad794d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bdc expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.585008:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad794ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bdc expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.585022:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483012.585024:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788483012.585027:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369800, rc 0) 00000100:00100000:0.0:1788483012.585374:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+16:11349:x1875360064012672:12345-192.168.201.6@tcp:101:bash.0 Request processed in 3315us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483012.585387:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 142 00000100:00100000:1.0:1788483012.591785:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.591883:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064012928 00000100:00100000:3.0:1788483012.591902:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064012928 00000100:00100000:3.0:1788483012.591985:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 143 00000100:00100000:3.0:1788483012.591998:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+16:11349:x1875360064012928:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788483012.592030:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483012.592065:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077be3 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.592524:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.592684:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.592703:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.600337:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.600383:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.600399:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788483012.601504:0:6958:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788483012.601738:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.601751:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.601771:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.601825:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.602050:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.602059:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.602065:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483012.602071:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.602079:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.602096:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:2.0:1788483012.602099:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483012.602104:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.602110:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad794fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483012.602135:0:6958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b22f237e reply state 00000000c2953b6d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483012.602163:0:6958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788483012.602224:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad794f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 19 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.602289:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 18 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.602299:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb911fa9a00) 00010000:00010000:2.0:1788483012.602302:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483012.602305:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66c00, rc 0) 00000100:00100000:2.0:1788483012.602402:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+19:11349:x1875360064012928:12345-192.168.201.6@tcp:101:bash.0 Request processed in 10406us (10631us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788483012.602411:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 143 00010000:00010000:3.0:1788483012.607632:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.607672:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.607681:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.607687:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483012.607694:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.607703:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.607721:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb911fa9300) 00010000:00010000:3.0:1788483012.607724:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483012.607728:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.607733:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79501 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483012.611001:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.613713:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064013056 00000100:00100000:3.0:1788483012.613730:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064013056 00000100:00100000:3.0:1788483012.613861:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:3.0:1788483012.613889:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360064013056:12345-192.168.201.6@tcp:101:bash.0 00000100:00080000:2.0:1788483012.614028:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788483012.614141:0:12045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483012.614171:0:12045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bea expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483012.614226:0:12045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788483012.614274:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1788483012.614281:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483012.614295:0:12045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 6 pid: 12045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.614318:0:12045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 6 pid: 12045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.614333:0:12045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492a00, rc 0) 00000100:00100000:3.0:1788483012.614410:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064013056:12345-192.168.201.6@tcp:101:bash.0 Request processed in 538us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483012.614418:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:2.0:1788483012.630343:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.634575:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064013184 00000100:00100000:3.0:1788483012.634590:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064013184 00000100:00100000:0.0:1788483012.639296:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:0.0:1788483012.639314:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+6:11349:x1875360064013184:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788483012.639336:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483012.639358:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bf1 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.639402:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 7 pid: 12045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.639412:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483012.639416:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483012.639422:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.639461:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 7 pid: 12045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.639478:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 7 pid: 12045 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483012.639508:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6663:1875360072411264:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788483012.639624:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483012.642480:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.642590:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064013312 00000100:00100000:3.0:1788483012.642600:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064013312 00010000:00010000:3.0:1788483012.642656:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 8 pid: 12045 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483012.642706:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:3.0:1788483012.642718:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064013312:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483012.642735:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483012.642760:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 8 pid: 12045 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.642793:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 8 pid: 12045 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.642818:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483012.642823:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483012.642831:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.642841:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.642888:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483012.642907:0:5794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d18e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5794:1875360072411392:192.168.201.6@tcp:105: 00000100:00100000:3.0:1788483012.643025:0:5794:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903069d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788483012.643468:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79516 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bea expref: 8 pid: 12045 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483012.643485:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6663:1875360072411264:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788483012.643507:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.643531:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369200, rc 0) 00000100:00100000:0.0:1788483012.643583:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:11349:x1875360064013184:12345-192.168.201.6@tcp:101:bash.0 Request processed in 4274us (13252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483012.643592:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:3.0:1788483012.646759:0:5794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d18e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5794:1875360072411392:192.168.201.6@tcp:105: 00010000:00010000:3.0:1788483012.646787:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483012.647750:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064013312:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 5027us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483012.647764:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1788483012.648802:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.649009:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064013568 00000100:00100000:3.0:1788483012.649246:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064013568 00000100:00100000:3.0:1788483012.649502:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:2.0:1788483012.649662:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+18:11349:x1875360064013568:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:2.0:1788483012.650888:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+19:11349:x1875360064013568:12345-192.168.201.6@tcp:35:bash.0 Request processed in 1354us (2087us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788483012.653997:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:2.0:1788483012.759354:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.763108:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064013824 00000100:00100000:3.0:1788483012.763154:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064013824 00000100:00100000:3.0:1788483012.763233:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:3.0:1788483012.763244:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+19:11359:x1875360064013824:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483012.763299:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483012.763319:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79524 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bf8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483012.763473:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788483012.763632:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79524 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf8 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.763650:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483012.763652:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483012.763658:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf8 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.763673:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492800, rc 0) 00000100:00100000:3.0:1788483012.763744:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+20:11359:x1875360064013824:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 502us (4399us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1788483012.763752:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 144 00000100:00100000:3.0:1788483012.768922:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483012.769317:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064014080 00000100:00100000:1.0:1788483012.769326:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064014080 00000100:00100000:1.0:1788483012.769400:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:1.0:1788483012.769410:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+20:11359:x1875360064014080:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788483012.769690:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+21:11359:x1875360064014080:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 280us (787us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788483012.769698:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:1.0:1788483012.855653:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483012.855761:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064014208 00000100:00100000:2.0:1788483012.855771:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064014208 00000100:00100000:2.0:1788483012.855838:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 145 00000100:00100000:2.0:1788483012.855850:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+21:11365:x1875360064014208:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483012.855874:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483012.855894:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077bff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.855986:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.856011:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.856024:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483012.856083:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788483012.856087:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483012.856111:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.856137:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bff expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.856167:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bff expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.856176:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:2.0:1788483012.856179:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483012.856183:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66e00, rc 0) 00000100:00100000:2.0:1788483012.856405:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+22:11365:x1875360064014208:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 557us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483012.856413:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 145 00000100:00100000:3.0:1788483012.863122:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483012.863446:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064014464 00000100:00100000:1.0:1788483012.863459:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064014464 00000100:00100000:1.0:1788483012.863576:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 146 00000100:00100000:1.0:1788483012.863589:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+22:11365:x1875360064014464:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788483012.863615:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483012.863643:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c06 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.863773:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.863790:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.863804:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483012.863820:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788483012.864000:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c06 expref: 25 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.864021:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c06 expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.864059:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb911fa9a00) 00010000:00010000:1.0:1788483012.864062:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483012.864067:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626800, rc 0) 00000100:00100000:1.0:1788483012.864199:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+24:11365:x1875360064014464:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 612us (1088us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788483012.864207:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 146 00000100:00100000:3.0:1788483012.874222:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.874324:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483012.874574:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064014592 00000100:00100000:2.0:1788483012.874587:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064014592 00000100:00100000:2.0:1788483012.874679:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1788483012.874691:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+24:2352:x1875360064014592:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483012.874708:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483012.874747:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c06 expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.874775:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb911fa9a00) 00010000:00010000:2.0:1788483012.874780:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483012.874855:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+23:2352:x1875360064014592:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 166us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483012.874862:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788483012.874950:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064014848 00000100:00100000:0.0:1788483012.874956:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064014848 00000100:00100000:0.0:1788483012.875009:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 147 00000100:00100000:0.0:1788483012.875018:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+23:11365:x1875360064014848:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788483012.875039:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483012.875055:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c0d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.875163:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad7955c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.875188:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad7955c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.875198:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad7955c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483012.875213:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788483012.875390:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c0d expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.875407:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad7955c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c0d expref: 25 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.875414:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb911fa9a00) 00010000:00010000:0.0:1788483012.875417:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788483012.875419:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369e00, rc 0) 00000100:00100000:0.0:1788483012.875446:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+25:11365:x1875360064014848:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 431us (1123us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788483012.875452:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 147 00000100:00100000:2.0:1788483012.883800:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483012.883880:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064014976 00000100:00100000:0.0:1788483012.883895:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064014976 00000100:00100000:0.0:1788483012.884138:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:0.0:1788483012.884150:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360064014976:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:0.0:1788483012.884222:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.884289:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.884318:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788483012.884324:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788483012.884329:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.888645:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483012.888672:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 6 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483012.888690:0:6660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920895880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1875360072411520:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788483012.888831:0:6660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fe3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483012.892645:0:6660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920895880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6660:1875360072411520:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788483012.892676:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483012.894202:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.894426:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064015104 00000100:00100000:3.0:1788483012.894438:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064015104 00002000:00100000:3.0:1788483012.894548:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9eb93ff53480 x1875360064015104/t0(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:518/0 lens 504/0 e 0 to 0 dl 1788483023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788483012.894580:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb93ff53480 with x1875360064015104 ext(0->12) 00010000:00010000:3.0:1788483012.894592:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 7 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.894609:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 7 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483012.894617:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eb93ff53480 00000100:00100000:3.0:1788483012.894668:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1788483012.894680:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064015104:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:3.0:1788483012.895197:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360064015104:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 517us (1000us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788483012.895205:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00002000:00100000:3.0:1788483012.895213:0:6668:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9eb93ff53480 x1875360064015104/t4294967305(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:518/0 lens 504/448 e 0 to 0 dl 1788483023 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788483012.895221:0:6668:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb93ff53480 with x1875360064015104 ext(0->12) 00010000:00010000:3.0:1788483012.895227:0:6668:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 9 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.895239:0:6668:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 9 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483012.895245:0:6668:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eb93ff53480 00000100:00100000:1.0:1788483012.914934:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483012.915054:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064015232 00000100:00100000:2.0:1788483012.915065:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064015232 00010000:00010000:2.0:1788483012.915105:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 9 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483012.915162:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:2.0:1788483012.915173:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+9:2351:x1875360064015232:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483012.915192:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788483012.915213:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788483012.915217:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788483012 00002000:00010000:2.0:1788483012.915219:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788483013 00002000:00010000:2.0:1788483012.915221:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788483012 00010000:00010000:2.0:1788483012.915228:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 9 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.915302:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 9 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.915327:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d103ee/0x42820277aad7951d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bf1 expref: 9 pid: 6663 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.915343:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483012.915347:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483012.915353:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.915362:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.915387:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483012.915461:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+8:2351:x1875360064015232:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 289us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483012.915468:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00010000:00010000:1.0:1788483012.915870:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.915881:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.915912:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.915921:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.915930:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.915937:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483012.915942:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.915965:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.915979:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.915987:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000256e6867/0x42820277aad7956a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483012.916049:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064014976:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 31900us (32259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483012.916057:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1788483012.926846:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.927049:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064015488 00000100:00100000:3.0:1788483012.927082:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064015488 00000100:00100000:3.0:1788483012.927157:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1788483012.927169:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918888c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+25:11365:x1875360064015488:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:3.0:1788483012.927246:0:5810:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad7955c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c0d expref: 25 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483012.927622:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788483012.927668:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788483012.929667:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1788483012.929942:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.929964:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 29 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.929973:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.930020:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 29 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.930039:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 29 pid: 6958 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483012.930055:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1875360072411648:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483012.930473:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903069d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483012.939340:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.940048:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1875360072411648:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483012.940085:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483012.940434:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064015616 00000100:00100000:2.0:1788483012.940456:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064015616 00010000:00010000:2.0:1788483012.940543:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 30 pid: 6958 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483012.940591:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:2.0:1788483012.940604:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+30:2351:x1875360064015616:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483012.940635:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483012.940645:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 30 pid: 6958 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.940661:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 30 pid: 6958 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.940690:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad79508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077be3 expref: 30 pid: 6958 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.940709:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb911fa9a00) 00010000:00010000:2.0:1788483012.940714:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.940724:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.940743:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483012.940767:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483012.940852:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+29:2351:x1875360064015616:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 250us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483012.940862:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00010000:00010000:1.0:1788483012.941696:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483012.941706:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788483012.941884:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1788483012.942076:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788483012.942206:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918326300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1875360072411776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788483012.942296:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483012.942330:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90854a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788483012.943630:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072411776 00000100:00100000:0.0:1788483012.943651:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072411776 00000100:00100000:0.0:1788483012.943739:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483012.943753:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1875360072411776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788483012.943908:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1875360072411776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 157us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483012.943937:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788483012.944176:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918326300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1875360072411776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788483012.945014:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788483012.945098:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1875360072411904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788483012.945548:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483012.945579:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90854a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788483012.945665:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072411904 00000100:00100000:1.0:1788483012.945672:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072411904 00000100:00100000:1.0:1788483012.945712:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788483012.945719:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875360072411904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788483012.945898:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5810:x1875360072411904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 178us (349us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788483012.945906:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483012.946078:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1875360072411904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788483012.946219:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788483012.946580:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.946592:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.946599:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.946605:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483012.946610:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.946617:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.946634:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb911fa9a00) 00010000:00010000:3.0:1788483012.946636:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788483012.946641:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.946647:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad79571 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788483012.946858:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788483012.946966:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788483012.946977:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330112726896ns, next at 331112724657ns, rc = 0 00000001:00080000:3.0:1788483012.946983:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788483012.947015:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb911fa9a00) 00010000:00010000:3.0:1788483012.947018:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788483012.947025:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad7955c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c0d expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483012.947996:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918888c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+32:11365:x1875360064015488:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 19965us (20300us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788483012.948012:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000020:00080000:3.0:1788483012.948022:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788483012.951114:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483012.951289:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064015744 00000100:00100000:3.0:1788483012.951299:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064015744 00000100:00100000:3.0:1788483012.951350:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:3.0:1788483012.951359:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+32:11365:x1875360064015744:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483012.951381:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483012.951403:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c14 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.951462:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c14 expref: 33 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.951475:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c14 expref: 33 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483012.951525:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:3.0:1788483012.951529:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483012.951533:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492800, rc 0) 00000100:00100000:3.0:1788483012.951580:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+33:11365:x1875360064015744:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 221us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483012.951587:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 148 00000100:00100000:1.0:1788483012.955699:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483012.955832:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064016000 00000100:00100000:2.0:1788483012.955845:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064016000 00000100:00100000:2.0:1788483012.955909:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1788483012.955920:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+33:11365:x1875360064016000:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788483012.956220:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+34:11365:x1875360064016000:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 301us (536us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788483012.956229:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1788483013.042992:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483013.043023:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072412032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483013.043107:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483013.043602:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072412032 00000100:00100000:0.0:1788483013.043615:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072412032 00000100:00100000:0.0:1788483013.043705:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788483013.043732:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072412032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483013.043783:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483013.043857:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072412032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483013.043865:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788483013.044395:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483013.044444:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072412032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483013.059747:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483013.059865:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064016256 00000100:00100000:2.0:1788483013.059875:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064016256 00000100:00100000:2.0:1788483013.059939:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 149 00000100:00100000:2.0:1788483013.059950:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+34:11375:x1875360064016256:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483013.059973:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483013.059994:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad7957f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483013.060116:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788483013.060296:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad7957f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c1b expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.060312:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:2.0:1788483013.060315:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483013.060320:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad7957f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c1b expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.060337:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66c00, rc 0) 00000100:00100000:2.0:1788483013.060415:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+35:11375:x1875360064016256:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 467us (694us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1788483013.060423:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 149 00000100:00100000:0.0:1788483013.067112:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483013.067347:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064016384 00000100:00100000:3.0:1788483013.067361:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064016384 00000100:00100000:3.0:1788483013.067438:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 150 00000100:00100000:3.0:1788483013.067451:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+35:11375:x1875360064016384:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1788483013.067553:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067571:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067582:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067595:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067600:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067605:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067709:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067740:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067745:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483013.067788:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067799:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067804:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067809:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067812:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483013.067816:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067821:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067831:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483013.067833:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483013.067837:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067840:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad7958d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067859:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067862:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067866:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067869:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483013.067870:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067873:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067878:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9231eb600) 00010000:00010000:3.0:1788483013.067879:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483013.067880:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067883:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79594 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067894:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067898:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067901:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067910:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483013.067914:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067920:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067928:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:3.0:1788483013.067930:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483013.067933:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.067938:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7959b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483013.068036:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+35:11375:x1875360064016384:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 585us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483013.068045:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 150 00000100:00100000:1.0:1788483013.071904:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483013.072024:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064016640 00000100:00100000:2.0:1788483013.072039:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064016640 00000100:00100000:2.0:1788483013.072346:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1788483013.072367:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+35:11375:x1875360064016640:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788483013.072744:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+36:11375:x1875360064016640:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 386us (850us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788483013.074055:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1788483013.090537:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483013.090592:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483013.090854:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064016896 00000100:00100000:3.0:1788483013.090869:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064016896 00000100:00100000:3.0:1788483013.092293:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:3.0:1788483013.092310:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064016896:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483013.092415:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064016896:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 110us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483013.092424:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00080000:2.0:1788483013.092481:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483013.094614:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064016768 00000100:00100000:0.0:1788483013.094630:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064016768 00000100:00100000:0.0:1788483013.094695:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 297 00000100:00100000:0.0:1788483013.094707:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360064016768:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483013.094784:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360064016768:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 80us (4191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483013.094793:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 297 00000100:00100000:2.0:1788483013.114173:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483013.114283:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064017152 00000100:00100000:0.0:1788483013.114294:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064017152 00000100:00100000:0.0:1788483013.114362:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 151 00000100:00100000:0.0:1788483013.114374:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+36:11378:x1875360064017152:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788483013.114398:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483013.114419:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c22 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114529:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114544:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114556:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114570:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114577:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114585:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114715:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114737:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114745:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483013.114756:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788483013.114873:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114879:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114890:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114894:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483013.114897:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114903:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114917:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483013.114922:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483013.114927:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114933:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad795a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114949:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114956:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114962:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114966:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483013.114968:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114979:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114985:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb907174d00) 00010000:00010000:0.0:1788483013.114987:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483013.114989:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.114993:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.115034:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.115043:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.115048:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483013.115049:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483013.115051:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369000, rc 0) 00000100:00100000:0.0:1788483013.115111:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+38:11378:x1875360064017152:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 741us (949us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788483013.115116:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 151 00000100:00100000:0.0:1788483013.124155:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483013.127429:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064017280 00000100:00100000:3.0:1788483013.127451:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064017280 00000100:00100000:2.0:1788483013.139764:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:2.0:1788483013.139779:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+38:11378:x1875360064017280:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1788483013.139848:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139866:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139877:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139911:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139918:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139937:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139943:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483013.139947:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139954:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139965:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:2.0:1788483013.139968:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483013.139973:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.139979:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483013.140056:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+38:11378:x1875360064017280:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 281us (15917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483013.140063:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 152 00000100:00100000:1.0:1788483013.146625:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483013.146804:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064017536 00000100:00100000:3.0:1788483013.146833:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064017536 00000100:00100000:2.0:1788483013.146997:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:2.0:1788483013.147012:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+38:11378:x1875360064017536:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788483013.148091:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+39:11378:x1875360064017536:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 1076us (1473us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788483013.148103:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:3.0:1788483013.449965:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483013.450385:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064017792 00000100:00100000:0.0:1788483013.450397:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064017792 00000100:00100000:0.0:1788483013.450472:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:0.0:1788483013.450486:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+39:11409:x1875360064017792:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1788483013.450543:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483013.450565:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c29 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.451647:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.451672:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.451686:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483013.451698:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788483013.451886:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c29 expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.451915:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c29 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.451927:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483013.451930:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483013.451934:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368000, rc 0) 00000100:00100000:0.0:1788483013.452416:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+41:11409:x1875360064017792:12345-192.168.201.6@tcp:101:cat.0 Request processed in 1930us (2463us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788483013.452426:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 153 00000100:00100000:1.0:1788483013.465394:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483013.465508:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483013.465617:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064017920 00000100:00100000:2.0:1788483013.465630:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064017920 00000100:00100000:2.0:1788483013.465729:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1788483013.465739:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+41:2351:x1875360064017920:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483013.465758:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483013.465784:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad795d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c29 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.465809:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:2.0:1788483013.465815:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483013.465868:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+40:2351:x1875360064017920:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 131us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483013.465875:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788483013.465942:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064018176 00000100:00100000:0.0:1788483013.465947:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064018176 00000100:00100000:0.0:1788483013.465978:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1788483013.466000:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+40:11409:x1875360064018176:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:0.0:1788483013.466305:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+41:11409:x1875360064018176:12345-192.168.201.6@tcp:35:cat.0 Request processed in 305us (795us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788483013.466312:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00010000:00010000:0.0:1788483013.491146:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483013.542864:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483013.543002:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064018432 00000100:00100000:2.0:1788483013.543015:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064018432 00000100:00100000:2.0:1788483013.543086:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 154 00000100:00100000:2.0:1788483013.543097:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+41:11415:x1875360064018432:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:2.0:1788483013.543127:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483013.543131:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788483013.543384:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad79539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bff expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.543404:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:2.0:1788483013.543409:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483013.543425:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c30 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.543654:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.543696:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.543706:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.543751:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.543768:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 41 pid: 5807 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483013.543788:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93704d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072412160:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483013.543931:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483013.548899:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93704d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072412160:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483013.548935:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483013.549942:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483013.550240:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064018560 00000100:00100000:3.0:1788483013.550290:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064018560 00010000:00010000:3.0:1788483013.550336:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 42 pid: 5807 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483013.550373:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:3.0:1788483013.550383:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+42:2351:x1875360064018560:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483013.550399:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483013.550406:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 42 pid: 5807 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.550419:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 42 pid: 5807 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.550663:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad795b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c22 expref: 42 pid: 5807 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.550686:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:3.0:1788483013.550692:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.550703:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.550711:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483013.550768:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483013.550841:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+41:2351:x1875360064018560:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 458us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483013.550849:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00010000:00010000:0.0:1788483013.551123:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.551132:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483013.551152:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788483013.551364:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad795e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 42 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.551383:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 41 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.551390:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483013.551392:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788483013.551395:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66600, rc 0) 00000100:00100000:0.0:1788483013.551440:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+41:11415:x1875360064018432:12345-192.168.201.6@tcp:101:dd.0 Request processed in 8336us (8584us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788483013.551448:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 154 00000100:00100000:2.0:1788483013.558788:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483013.558870:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064018816 00000100:00100000:0.0:1788483013.558882:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064018816 00000100:00100000:0.0:1788483013.558947:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 155 00000100:00100000:0.0:1788483013.558957:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+41:11415:x1875360064018816:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:0.0:1788483013.559216:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.559232:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.559243:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483013.559322:0:6958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1788483013.559348:0:6958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b59fdc25 reply state 0000000004f79d55 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483013.559357:0:6958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788483013.559543:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+44:11415:x1875360064018816:12345-192.168.201.6@tcp:36:dd.0 Request processed in 587us (769us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788483013.559551:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 155 00000020:00080000:0.0:1788483013.559556:0:6958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788483013.562513:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.562532:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.562540:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.562547:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483013.562551:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.562560:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.562598:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483013.562602:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483013.562608:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.562614:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad795f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483013.952239:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483013.952596:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064018944 00000100:00100000:1.0:1788483013.952606:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064018944 00000100:00100000:1.0:1788483013.952672:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 156 00000100:00100000:1.0:1788483013.952686:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+43:11429:x1875360064018944:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:1.0:1788483013.952775:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483013.952799:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad795fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c37 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.952870:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.952883:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.952895:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.952911:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.952933:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.952940:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.953038:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.953049:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 44 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.953128:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.953163:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 44 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483013.953177:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 44 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483013.953190:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918324e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072412288:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788483013.953369:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483013.957061:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483013.957225:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918324e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072412288:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788483013.957294:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483013.957390:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064019200 00000100:00100000:0.0:1788483013.957400:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064019200 00000100:00100000:0.0:1788483013.957498:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:0.0:1788483013.957511:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+45:5593:x1875360064019200:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788483013.958139:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+46:5593:x1875360064019200:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 628us (1092us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788483013.958148:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:3.0:1788483013.960887:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483013.960985:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064019328 00000100:00100000:2.0:1788483013.960997:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064019328 00010000:00010000:2.0:1788483013.961045:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 46 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483013.961094:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:2.0:1788483013.961124:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+46:2351:x1875360064019328:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483013.961142:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483013.961151:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 46 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.961176:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 46 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.961208:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad795e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c30 expref: 46 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.961228:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:2.0:1788483013.961233:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.961245:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.961411:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483013.961452:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483013.961527:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+45:2351:x1875360064019328:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 405us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483013.961535:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00010000:00010000:0.0:1788483013.961875:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.961886:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483013.961954:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788483013.961960:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788483013.961996:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962024:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962035:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962052:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962059:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962066:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483013.962071:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962079:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962091:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483013.962095:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483013.962100:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962106:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad79604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962119:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962126:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962134:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962139:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483013.962149:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962156:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962164:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9050b3d00) 00010000:00010000:0.0:1788483013.962938:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483013.962945:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.962953:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad7960b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.963009:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad795fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c37 expref: 45 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.963037:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c37 expref: 44 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483013.963046:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483013.963048:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483013.963051:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627e00, rc 0) 00000100:00100000:0.0:1788483013.963113:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+44:11429:x1875360064018944:12345-192.168.201.6@tcp:101:stat.0 Request processed in 10429us (10889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483013.963123:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 156 00000100:00100000:3.0:1788483014.040667:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483014.040884:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064019584 00000100:00100000:0.0:1788483014.040898:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064019584 00000100:00100000:0.0:1788483014.040996:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 157 00000100:00100000:0.0:1788483014.041010:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+44:11435:x1875360064019584:12345-192.168.201.6@tcp:36:truncate.0 00010000:00010000:0.0:1788483014.041109:0:6958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1788483014.041287:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788483014.041473:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79612 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c37 expref: 44 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.041509:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483014.041516:0:6958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483014.042942:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.042966:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.042980:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483014.043061:0:6958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1788483014.043102:0:6958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000696fab8c reply state 0000000044b064da transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483014.043113:0:6958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788483014.043991:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+46:11435:x1875360064019584:12345-192.168.201.6@tcp:36:truncate.0 Request processed in 2975us (3332us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1788483014.044004:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 157 00000020:00080000:0.0:1788483014.044012:0:6958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788483014.049938:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.049962:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.049972:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.049997:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483014.050004:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.050012:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.050033:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483014.050036:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483014.050042:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.050049:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79619 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483014.258441:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483014.258625:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064019712 00000100:00100000:0.0:1788483014.258638:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064019712 00000100:00100000:0.0:1788483014.258736:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 158 00000100:00100000:0.0:1788483014.258748:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+45:11450:x1875360064019712:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:0.0:1788483014.258797:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483014.258832:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79620 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c3e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.258939:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.258958:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.258972:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259011:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259018:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259024:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259171:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259180:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259187:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483014.259235:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788483014.259241:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788483014.259314:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259330:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259339:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259346:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259365:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259372:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483014.259377:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259386:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259401:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483014.259405:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483014.259410:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259417:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259434:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259440:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259446:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259452:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483014.259455:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259472:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259481:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb907174d00) 00010000:00010000:0.0:1788483014.259495:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483014.259499:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259505:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad7962e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259544:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79620 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 47 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259560:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 46 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.259568:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483014.259571:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483014.259574:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369c00, rc 0) 00000100:00100000:0.0:1788483014.259655:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+46:11450:x1875360064019712:12345-192.168.201.6@tcp:101:stat.0 Request processed in 908us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483014.259663:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 158 00000100:00100000:3.0:1788483014.354150:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483014.356802:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064019968 00000100:00100000:2.0:1788483014.356894:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064019968 00000100:00100000:2.0:1788483014.357055:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 159 00000100:00100000:2.0:1788483014.357093:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+46:11460:x1875360064019968:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483014.357128:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483014.357164:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad7963c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483014.357363:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788483014.358199:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad7963c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c45 expref: 48 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.358220:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:2.0:1788483014.358223:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483014.358229:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66600/0x42820277aad7963c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c45 expref: 48 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.358304:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66600, rc 0) 00000100:00100000:2.0:1788483014.359071:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+47:11460:x1875360064019968:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1976us (4931us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1788483014.359083:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 159 00000100:00100000:1.0:1788483014.365023:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.365097:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064020224 00000100:00100000:1.0:1788483014.365110:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064020224 00000100:00100000:1.0:1788483014.365175:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788483014.365188:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918888850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+47:11460:x1875360064020224:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788483014.365599:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918888850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+48:11460:x1875360064020224:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 412us (590us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788483014.365608:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:3.0:1788483014.416675:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483014.416790:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064020480 00000100:00100000:0.0:1788483014.416805:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064020480 00000100:00100000:0.0:1788483014.416895:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 160 00000100:00100000:0.0:1788483014.416908:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+48:11466:x1875360064020480:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788483014.416957:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483014.416983:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad7964a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c4c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.417735:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.417759:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 49 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.417770:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.417819:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 49 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.417836:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 49 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483014.417856:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb920897b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072412416:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788483014.418031:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91086ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483014.422432:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.422677:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064020608 00000100:00100000:1.0:1788483014.422702:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064020608 00010000:00010000:1.0:1788483014.422782:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 50 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483014.422843:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb920897b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072412416:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788483014.422880:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483014.422915:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:1.0:1788483014.422929:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+50:2351:x1875360064020608:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483014.422950:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483014.422960:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 50 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.422978:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 50 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.423017:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad79635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c3e expref: 50 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.423038:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:1.0:1788483014.423044:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.423078:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.423086:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.423130:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483014.423174:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.423184:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483014.423222:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:1.0:1788483014.423231:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+49:2351:x1875360064020608:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 303us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483014.423241:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00010000:00010000:0.0:1788483014.423663:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad7964a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.423688:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 49 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.423696:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483014.423699:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788483014.423954:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368400, rc 0) 00000100:00100000:0.0:1788483014.424171:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+49:11466:x1875360064020480:12345-192.168.201.6@tcp:101:bash.0 Request processed in 7264us (7510us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788483014.424181:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 160 00000100:00100000:0.0:1788483014.429278:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.429349:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064020864 00000100:00100000:1.0:1788483014.429367:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064020864 00000100:00100000:1.0:1788483014.429462:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:1.0:1788483014.429476:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+49:11466:x1875360064020864:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:1.0:1788483014.429867:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.429891:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.429906:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788483014.429964:0:6958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1788483014.429990:0:6958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d0e8dd4 reply state 00000000101df303 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483014.430000:0:6958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483014.430119:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+52:11466:x1875360064020864:12345-192.168.201.6@tcp:36:bash.0 Request processed in 643us (877us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788483014.430149:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 161 00000020:00080000:1.0:1788483014.430155:0:6958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788483014.434968:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.435282:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.435292:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.435299:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483014.435304:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.435312:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.435349:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483014.435352:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483014.435357:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.435364:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad7965f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483014.441932:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.442081:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064020992 00000100:00100000:1.0:1788483014.442090:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064020992 00000100:00100000:1.0:1788483014.442429:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:1.0:1788483014.442442:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+51:11466:x1875360064020992:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788483014.442469:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483014.442500:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79666 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c53 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.442585:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.442602:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 52 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.442611:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.442646:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 52 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.442660:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 52 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483014.442675:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918327b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072412544:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788483014.442782:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483014.446836:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918327b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072412544:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788483014.446869:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483014.448171:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.448318:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064021120 00000100:00100000:1.0:1788483014.448328:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064021120 00010000:00010000:1.0:1788483014.448368:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 53 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483014.448410:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:1.0:1788483014.448431:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+53:2352:x1875360064021120:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483014.448447:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483014.448455:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 53 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.448468:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 53 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.448503:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79651 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c4c expref: 53 pid: 5806 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.448521:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:1.0:1788483014.448527:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.448538:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.448546:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.448813:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483014.448879:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+52:2352:x1875360064021120:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 450us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483014.448887:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00010000:00010000:3.0:1788483014.451234:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.451507:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483014.451662:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788483014.451668:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483014.451693:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.451803:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79666 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c53 expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.451822:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c53 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.451846:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:2.0:1788483014.451849:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483014.451853:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627a00, rc 0) 00000100:00100000:2.0:1788483014.451967:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+51:11466:x1875360064020992:12345-192.168.201.6@tcp:101:bash.0 Request processed in 9527us (10042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483014.451977:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:2.0:1788483014.455840:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483014.455919:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064021376 00000100:00100000:3.0:1788483014.455930:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064021376 00000100:00100000:3.0:1788483014.455997:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1788483014.456009:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+51:11466:x1875360064021376:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:3.0:1788483014.456275:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+52:11466:x1875360064021376:12345-192.168.201.6@tcp:35:bash.0 Request processed in 241us (416us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788483014.456283:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00010000:00010000:3.0:1788483014.515886:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483014.516126:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788483014.516131:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483014.516565:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788483014.516573:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788483014.562405:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483014.562530:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064021632 00000100:00100000:3.0:1788483014.562540:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064021632 00000100:00100000:3.0:1788483014.562594:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:3.0:1788483014.562606:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+52:11476:x1875360064021632:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483014.562658:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483014.562686:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c5a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483014.562815:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788483014.563080:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79674 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c5a expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.563098:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483014.563102:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483014.563106:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c5a expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.563124:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493400, rc 0) 00000100:00100000:3.0:1788483014.563190:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+53:11476:x1875360064021632:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 586us (799us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1788483014.563197:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:1.0:1788483014.567053:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483014.567183:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064021760 00000100:00100000:0.0:1788483014.567194:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064021760 00000100:00100000:0.0:1788483014.567289:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:0.0:1788483014.567300:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+53:11476:x1875360064021760:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1788483014.567383:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567400:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567424:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567442:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567449:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567472:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567598:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567608:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567615:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483014.567654:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567664:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567669:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567674:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567678:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483014.567681:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567685:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567694:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483014.567704:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483014.567723:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567731:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368600/0x42820277aad79682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567746:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567752:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567759:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567765:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483014.567768:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567772:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567778:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb907174d00) 00010000:00010000:0.0:1788483014.567779:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483014.567781:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567784:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369a00/0x42820277aad79689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567795:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567804:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567807:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567810:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483014.567812:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567815:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567819:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:0.0:1788483014.567820:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483014.567822:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.567826:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483014.567895:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+53:11476:x1875360064021760:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 597us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483014.567903:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 164 00000100:00100000:2.0:1788483014.574664:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483014.574766:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064022016 00000100:00100000:3.0:1788483014.574778:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064022016 00000100:00100000:3.0:1788483014.574840:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1788483014.574851:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+53:11476:x1875360064022016:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788483014.575122:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+54:11476:x1875360064022016:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 271us (469us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788483014.575130:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1788483014.654917:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483014.654979:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064022272 00000100:00100000:3.0:1788483014.655013:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064022272 00000100:00100000:3.0:1788483014.655211:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:3.0:1788483014.655226:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+54:11479:x1875360064022272:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483014.655290:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483014.655319:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.655414:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.655431:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.655443:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.655458:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.655464:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.655470:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658135:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad796ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658160:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad796ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658173:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad796ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483014.658198:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788483014.658403:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658411:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658419:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658425:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483014.658431:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658440:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658453:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483014.658456:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483014.658459:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658464:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7969e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658487:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658493:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658509:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658515:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483014.658518:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658524:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658530:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9231eb600) 00010000:00010000:3.0:1788483014.658531:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483014.658534:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658537:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658605:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad79697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c61 expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658620:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad796ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c61 expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.658627:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:3.0:1788483014.658629:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483014.658632:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb900030e00, rc 0) 00000100:00100000:3.0:1788483014.658732:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+56:11479:x1875360064022272:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 3508us (3834us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788483014.658754:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 165 00000001:00080000:0.0:1788483014.662239:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967448 is committed 00000001:00080000:0.0:1788483014.664177:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000001:00080000:0.0:1788483014.664244:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000004:00080000:0.0:1788483014.664276:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788483014.664300:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eb903069c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788483014.664305:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb93f7a7500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eb903069d80 00000020:00080000:0.0:1788483014.664326:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb93f7a7100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eb93f1e9000 00000020:00080000:1.0:1788483014.664445:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788483014.664693:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788483014.665210:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483014.665238:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f1ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072412672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788483014.665351:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483014.665491:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072412672 00000100:00100000:2.0:1788483014.665502:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072412672 00000100:00100000:2.0:1788483014.665646:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788483014.665658:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072412672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788483014.665694:0:12045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00080000:0.0:1788483014.665852:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788483014.665915:0:12045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9a15c4, atime: 0x6a9a15c5, ctime: 0x6a9a15c4, blocks: 0x1 00010000:00010000:2.0:1788483014.665929:0:12045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.665950:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1788483014.665955:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483014.665962:0:12045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.666064:0:12045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.666097:0:12045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.666106:0:12045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.666494:0:12045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788483014.667562:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072412672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1900us (2206us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788483014.667574:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788483014.667971:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb93f1ba300/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788483014.667992:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f1ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072412672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788483014.668341:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.668386:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483014.668563:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064022528 00000100:00100000:3.0:1788483014.668572:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064022528 00000100:00100000:3.0:1788483014.668636:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1788483014.668646:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+18:2352:x1875360064022528:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483014.668659:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483014.668685:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad796ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c61 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.668706:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:3.0:1788483014.668879:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483014.668933:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+17:2352:x1875360064022528:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 288us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483014.668939:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1788483014.669203:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064022400 00000100:00100000:2.0:1788483014.669215:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064022400 00000100:00100000:2.0:1788483014.669329:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:2.0:1788483014.669342:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+17:11479:x1875360064022400:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1788483014.669445:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.669466:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.669488:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483014.669494:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.669502:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.669517:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483014.669533:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.669544:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.669588:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.669602:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.669618:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.669624:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad796ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483014.669649:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483014.669653:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483014.669655:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483014.670167:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.670174:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483014.670179:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.670187:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.670202:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:2.0:1788483014.670206:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483014.670210:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.670217:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad796c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483014.670365:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+17:11479:x1875360064022400:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 1024us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483014.670375:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:1.0:1788483014.673703:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483014.674186:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064022784 00000100:00100000:3.0:1788483014.674203:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064022784 00000100:00100000:3.0:1788483014.674326:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:3.0:1788483014.674342:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+17:11479:x1875360064022784:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788483014.675743:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+18:11479:x1875360064022784:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 1396us (2045us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788483014.675756:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:0.0:1788483014.898381:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483014.898488:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064023040 00000100:00100000:3.0:1788483014.898504:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064023040 00000100:00100000:3.0:1788483014.898625:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:3.0:1788483014.898638:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+18:11497:x1875360064023040:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:3.0:1788483014.898672:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483014.898699:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad796c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c68 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.898881:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.898901:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.898919:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483014.898932:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788483014.899117:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad796c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c68 expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.899140:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c68 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483014.899151:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:3.0:1788483014.899154:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788483014.899158:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493000, rc 0) 00000100:00100000:3.0:1788483014.899223:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+20:11497:x1875360064023040:12345-192.168.201.6@tcp:101:cat.0 Request processed in 589us (856us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788483014.899231:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:3.0:1788483014.931996:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.932161:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064023168 00000100:00100000:1.0:1788483014.932172:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064023168 00000100:00100000:1.0:1788483014.932337:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:1.0:1788483014.932351:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+20:11498:x1875360064023168:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788483014.932385:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483014.932409:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c6f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.932523:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad796e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.932537:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad796e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.932547:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad796e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483014.934084:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788483014.934104:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788483014.934228:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad796e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.934281:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c6f expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.934300:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad796e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c6f expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.934309:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:1.0:1788483014.934313:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483014.934316:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626c00, rc 0) 00000100:00100000:1.0:1788483014.934393:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+21:11498:x1875360064023168:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 2045us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483014.934401:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:2.0:1788483014.949022:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.951142:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064023552 00000100:00100000:1.0:1788483014.951163:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064023552 00000100:00100000:1.0:1788483014.951246:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:1.0:1788483014.951271:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+21:11498:x1875360064023552:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788483014.953431:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+22:11498:x1875360064023552:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 427us (2701us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788483014.953449:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:0.0:1788483014.956647:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483014.956855:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064023680 00000100:00100000:2.0:1788483014.956867:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064023680 00000100:00100000:2.0:1788483014.957022:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1788483014.957035:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9057b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+22:11498:x1875360064023680:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:2.0:1788483014.957054:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788483014.957086:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad7966d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c53 expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.957125:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad796cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c68 expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.957139:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c14 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483014.957152:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eba00) 00010000:00010000:2.0:1788483014.957168:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483014.957421:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9057b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+19:11498:x1875360064023680:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 388us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483014.957429:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1788483014.968306:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483014.968412:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064023808 00000100:00100000:1.0:1788483014.968426:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064023808 00000100:00100000:1.0:1788483014.968498:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:1.0:1788483014.968510:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+19:11498:x1875360064023808:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:1.0:1788483014.968669:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.968695:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483014.968708:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483014.969097:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788483014.969193:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+19:11498:x1875360064023808:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 684us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483014.969199:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:3.0:1788483015.004050:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.008017:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064023936 00000100:00100000:2.0:1788483015.008038:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064023936 00000100:00100000:2.0:1788483015.008214:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 170 00000100:00100000:2.0:1788483015.008231:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+19:11500:x1875360064023936:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483015.008276:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483015.008301:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad796f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c76 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.008391:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.008409:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.008421:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.008462:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.008508:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.008516:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.011719:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.011743:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.011754:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483015.011799:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788483015.011803:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483015.011821:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.011833:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.011842:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.011848:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.011868:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012320:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483015.012324:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012332:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012345:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:2.0:1788483015.012349:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483015.012353:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012360:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad796f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012375:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012381:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012386:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012391:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483015.012394:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012411:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012420:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb911fa9800) 00010000:00010000:2.0:1788483015.012422:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483015.012425:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012431:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012482:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad796f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012496:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.012503:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3800) 00010000:00010000:2.0:1788483015.012505:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483015.012507:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66800, rc 0) 00000100:00100000:2.0:1788483015.012586:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+20:11500:x1875360064023936:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 4359us (8547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483015.012594:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 170 00000040:00080000:0.0:1788483015.538516:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788483015.538526:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483015.538578:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788483015.538586:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788483015.538800:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937055180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072412800:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788483015.538910:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903188240 going to sleep for 11 seconds 00010000:00010000:3.0:1788483015.542054:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483015.548331:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483015.548405:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064024064 00000100:00100000:1.0:1788483015.548415:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064024064 00000100:00100000:1.0:1788483015.548486:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:1.0:1788483015.548496:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+21:11512:x1875360064024064:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788483015.548528:0:5807:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788483015.548631:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+21:11512:x1875360064024064:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483015.548639:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:0.0:1788483015.550417:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937055180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072412800:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788483015.551982:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483015.552095:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064024192 00000100:00100000:3.0:1788483015.552110:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064024192 00000100:00100000:3.0:1788483015.553667:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:3.0:1788483015.553684:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+20:11512:x1875360064024192:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788483015.553763:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553779:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553789:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553803:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553810:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553816:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553840:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553849:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553854:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483015.553898:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788483015.553902:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483015.553915:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553926:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553932:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553938:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553944:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483015.553948:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553955:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553967:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:3.0:1788483015.553970:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483015.553975:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553980:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7970e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.553993:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554008:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554014:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554018:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483015.554022:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554028:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554036:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9eb9231eb100) 00010000:00010000:3.0:1788483015.554039:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483015.554042:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554048:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79715 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554064:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554070:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554075:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554080:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483015.554090:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554097:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554105:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3800) 00010000:00010000:3.0:1788483015.554107:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483015.554110:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483015.554117:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad7971c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483015.554206:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+20:11512:x1875360064024192:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 527us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483015.554214:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:1.0:1788483015.566952:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.567233:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064024448 00000100:00100000:2.0:1788483015.567244:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064024448 00000100:00100000:2.0:1788483015.567328:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:2.0:1788483015.567350:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+20:11512:x1875360064024448:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483015.567373:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483015.567393:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79723 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c7d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567502:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567519:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567531:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483015.567542:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788483015.567766:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567775:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567783:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567790:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483015.567794:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567802:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567816:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3800) 00010000:00010000:2.0:1788483015.567825:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483015.567830:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567837:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7972a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567880:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79723 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c7d expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567891:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:2.0:1788483015.567893:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483015.567897:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79723 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c7d expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.567907:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67c00, rc 0) 00000100:00100000:2.0:1788483015.568003:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+21:11512:x1875360064024448:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 655us (1060us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1788483015.568011:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:1.0:1788483015.588207:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483015.591641:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064024576 00000100:00100000:0.0:1788483015.591661:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064024576 00000100:00100000:0.0:1788483015.591773:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:0.0:1788483015.591788:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+21:11512:x1875360064024576:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788483015.591849:0:5806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788483015.592030:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+21:11512:x1875360064024576:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 244us (3829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483015.592043:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:1.0:1788483015.605930:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483015.605969:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064024832 00000100:00100000:1.0:1788483015.605979:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064024832 00000100:00100000:1.0:1788483015.606032:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 175 00000100:00100000:1.0:1788483015.606044:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+21:11512:x1875360064024832:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483015.606066:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483015.606077:0:6958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788483015.606105:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626c00/0x42820277aad796e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c6f expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.606122:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:1.0:1788483015.606127:0:6958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483015.606140:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79738 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c84 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788483015.613832:0:6958:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788483015.614747:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7973f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.614773:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7973f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.614789:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7973f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.614872:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626800/0x42820277aad79738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c84 expref: 23 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.614889:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7973f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c84 expref: 22 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.614899:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3200) 00010000:00010000:1.0:1788483015.614901:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483015.614905:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627200, rc 0) 00000100:00100000:1.0:1788483015.615067:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+22:11512:x1875360064024832:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 9021us (9143us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788483015.615101:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 175 00000100:00100000:0.0:1788483015.623811:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483015.624034:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064025088 00000100:00100000:1.0:1788483015.624048:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064025088 00000100:00100000:1.0:1788483015.624140:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:1.0:1788483015.624164:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+22:11512:x1875360064025088:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483015.624296:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483015.624324:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad7973f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c84 expref: 22 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624342:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3200) 00010000:00010000:1.0:1788483015.624353:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483015.624376:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624389:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624399:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624413:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624419:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624426:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624748:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624758:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624765:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624772:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483015.624776:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624784:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624794:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:1.0:1788483015.624797:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483015.624801:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624808:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad7974d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624817:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624824:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624830:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624841:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483015.624845:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624851:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624860:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdaaa16d3 (ffff9eb9050b3600) 00010000:00010000:1.0:1788483015.624862:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483015.624864:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.624870:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79754 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdaaa16d3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483015.624957:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+21:11512:x1875360064025088:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 804us (1168us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788483015.624965:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:0.0:1788483015.640579:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483015.640776:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064025216 00000100:00100000:1.0:1788483015.640785:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064025216 00000100:00100000:1.0:1788483015.642839:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00100000:1.0:1788483015.642864:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+21:11512:x1875360064025216:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483015.642887:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483015.642913:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad7975b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c8b expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.642951:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.642977:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.642988:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.643142:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad7975b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 23 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.643169:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 22 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.643184:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788483015.643189:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788483015.643193:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627400, rc 0) 00000100:00100000:1.0:1788483015.643322:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+22:11512:x1875360064025216:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 468us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483015.643330:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00100000:1.0:1788483015.658983:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.659288:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064025472 00000100:00100000:2.0:1788483015.659299:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064025472 00000100:00100000:2.0:1788483015.659356:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 178 00000100:00100000:2.0:1788483015.659366:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+22:11512:x1875360064025472:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788483015.659472:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.659490:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.659502:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483015.659814:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788483015.659826:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332825575330ns, next at 333825572318ns, rc = 0 00000004:00010000:2.0:1788483015.659915:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057fb2b9f reply state 000000009a4799c0 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483015.659926:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483015.660032:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+24:11512:x1875360064025472:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 667us (1060us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788483015.660041:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 178 00010000:00010000:1.0:1788483015.666031:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.666051:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.666059:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.666066:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483015.666081:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.666089:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.666107:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788483015.666110:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788483015.666115:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483015.666121:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79769 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483015.674930:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.675244:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064025600 00000100:00100000:2.0:1788483015.675281:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064025600 00000100:00100000:2.0:1788483015.675365:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 179 00000100:00100000:2.0:1788483015.675382:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+23:11512:x1875360064025600:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483015.675437:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483015.675479:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.675575:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.675597:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.675630:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:2.0:1788483015.675637:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483015.675645:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67800, rc 0) 00000100:00100000:2.0:1788483015.675808:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+24:11512:x1875360064025600:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 427us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483015.675822:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 179 00000100:00100000:1.0:1788483015.684155:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483015.684287:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064025728 00000100:00100000:0.0:1788483015.684302:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064025728 00000100:00100000:0.0:1788483015.684419:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:0.0:1788483015.684450:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+6:2351:x1875360064025728:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788483015.684498:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483015.685766:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064025728:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 1327us (1621us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788483015.685778:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1788483015.687995:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483015.688133:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064025984 00000100:00100000:1.0:1788483015.688145:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064025984 00000100:00100000:1.0:1788483015.688205:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1788483015.688216:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+24:11512:x1875360064025984:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788483015.689884:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+25:11512:x1875360064025984:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 1655us (1882us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788483015.689901:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1788483015.693820:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.694225:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064026240 00000100:00100000:2.0:1788483015.694240:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064026240 00000100:00100000:2.0:1788483015.694342:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 180 00000100:00100000:2.0:1788483015.694405:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+25:11512:x1875360064026240:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788483015.694532:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+25:11512:x1875360064026240:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 179us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483015.694539:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 180 00000100:00100000:0.0:1788483015.697380:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.697425:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064026368 00000100:00100000:2.0:1788483015.697442:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064026368 00000100:00100000:2.0:1788483015.697546:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 181 00000100:00100000:2.0:1788483015.697564:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+25:11512:x1875360064026368:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483015.697591:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483015.697621:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67200/0x42820277aad79777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077c99 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.697764:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7977e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.697788:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7977e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.697805:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7977e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483015.697863:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483015.697916:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7977e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.697963:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67200/0x42820277aad79777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c99 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.697992:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7977e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c99 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.698003:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:2.0:1788483015.698008:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788483015.698013:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67c00, rc 0) 00000100:00100000:2.0:1788483015.698108:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+26:11512:x1875360064026368:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 549us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483015.698118:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 181 00000100:00100000:3.0:1788483015.703621:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.703719:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064026496 00000100:00100000:2.0:1788483015.703729:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064026496 00000100:00100000:2.0:1788483015.703789:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:2.0:1788483015.703801:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064026496:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483015.703821:0:12045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483015.703842:0:12045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ca0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483015.703872:0:12045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a15c7, blocks: 0x1 00010000:00010000:2.0:1788483015.703899:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1788483015.703904:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483015.703914:0:12045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 8 pid: 12045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.703957:0:12045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 8 pid: 12045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.703971:0:12045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67e00, rc 0) 00000100:00100000:2.0:1788483015.704035:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064026496:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 236us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483015.704042:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:1.0:1788483015.708650:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483015.708755:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064026752 00000100:00100000:0.0:1788483015.708777:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064026752 00000100:00100000:0.0:1788483015.708845:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 182 00000100:00100000:0.0:1788483015.708866:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+26:11512:x1875360064026752:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788483015.708995:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+26:11512:x1875360064026752:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 139us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483015.709003:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 182 00000100:00100000:0.0:1788483015.713017:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483015.713129:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064026880 00000100:00100000:3.0:1788483015.713150:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064026880 00000100:00100000:3.0:1788483015.713300:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:3.0:1788483015.713316:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+8:11512:x1875360064026880:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483015.713344:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483015.713374:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ca7 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483015.713499:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 9 pid: 12045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483015.713511:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483015.713516:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483015.713522:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483015.713559:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 9 pid: 12045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483015.713573:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 9 pid: 12045 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483015.713589:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6662:1875360072412928:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788483015.713702:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903188240 going to sleep for 11 seconds 00000100:00100000:3.0:1788483015.717674:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483015.717792:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6662:1875360072412928:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788483015.717832:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483015.717851:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064027008 00000100:00100000:2.0:1788483015.717861:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064027008 00010000:00010000:2.0:1788483015.717899:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 10 pid: 12045 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483015.717943:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:2.0:1788483015.717953:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+10:2351:x1875360064027008:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483015.717968:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483015.717995:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 10 pid: 12045 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.718012:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 10 pid: 12045 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483015.718025:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492800, rc 0) 00010000:00010000:2.0:1788483015.718043:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79785 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca0 expref: 10 pid: 12045 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.718075:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483015.718079:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483015.718089:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483015.718101:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483015.718130:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+9:11512:x1875360064026880:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 4819us (5125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483015.718137:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00010000:00010000:2.0:1788483015.718145:0:8490:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483015.718163:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8490:1875360072413056:192.168.201.6@tcp:105: 00000100:00100000:2.0:1788483015.718231:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483015.725853:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.726135:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8490:1875360072413056:192.168.201.6@tcp:105: 00010000:00010000:2.0:1788483015.726176:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483015.726289:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+8:2351:x1875360064027008:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 8335us (8629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483015.726301:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:1.0:1788483015.726855:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064027136 00000100:00100000:1.0:1788483015.726873:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064027136 00002000:00100000:1.0:1788483015.726970:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9eb936e10a80 x1875360064027136/t0(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:521/0 lens 504/0 e 0 to 0 dl 1788483026 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483015.727018:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb936e10a80 with x1875360064027136 ext(0->8) 00002000:00010000:1.0:1788483015.727027:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb936e10a80 00000100:00100000:1.0:1788483015.727096:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1788483015.727117:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064027136:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788483015.732935:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+10:2352:x1875360064027136:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 5807us (7081us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788483015.732959:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00002000:00100000:1.0:1788483015.732983:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9eb936e10a80 x1875360064027136/t4294967314(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:521/0 lens 504/448 e 0 to 0 dl 1788483026 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483015.732996:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb936e10a80 with x1875360064027136 ext(0->8) 00002000:00010000:1.0:1788483015.733006:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb936e10a80 00000100:00100000:1.0:1788483015.737576:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.738979:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064027264 00000100:00100000:2.0:1788483015.738992:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064027264 00000100:00100000:2.0:1788483015.739055:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 183 00000100:00100000:2.0:1788483015.739066:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+26:11512:x1875360064027264:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788483015.892330:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:0.0:1788483015.892361:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1788483015.892386:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788483015.892449:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788483015.892476:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788483015.892589:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483015.892611:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072413184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788483015.892690:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483015.892801:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072413184 00000100:00100000:0.0:1788483015.892812:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072413184 00000100:00100000:0.0:1788483015.892899:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788483015.892912:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072413184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788483015.893127:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788483015.893132:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788483015 00002000:00010000:0.0:1788483015.893135:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788483015.893138:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788483015 -> 1788483015 00002000:00010000:0.0:1788483015.893140:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788483015.893209:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072413184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 298us (518us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788483015.893220:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1788483015.893301:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb92eb46680/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788483015.893326:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072413184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788483015.893693:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+18:11512:x1875360064027264:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 154620us (156119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483015.893725:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 183 00000100:00080000:2.0:1788483015.893772:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483015.897509:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483015.899636:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064027392 00000100:00100000:2.0:1788483015.899655:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064027392 00000100:00100000:2.0:1788483015.899726:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1788483015.899739:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+10:2351:x1875360064027392:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000040:00080000:1.0:1788483015.979170:0:12436:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483015.979184:0:12436:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483015.979270:0:12436:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788483015.979277:0:12436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788483016.000905:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+10:2351:x1875360064027392:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 101156us (103395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483016.000918:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000001:00080000:0.0:1788483016.000957:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1788483016.000967:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1788483016.000973:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1788483016.012865:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483016.012988:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064027648 00000100:00100000:1.0:1788483016.012999:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064027648 00000100:00100000:1.0:1788483016.015864:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 184 00000100:00100000:1.0:1788483016.015882:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+18:11512:x1875360064027648:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483016.015948:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483016.015981:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7977e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c99 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.016018:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788483016.016022:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483016.016054:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.016066:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.016075:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483016.016368:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f304df30 reply state 000000001a2009c7 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483016.016378:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483016.016496:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+19:11512:x1875360064027648:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 619us (3644us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788483016.016503:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 184 00000100:00080000:3.0:1788483016.019541:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788483016.024199:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.024227:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.024240:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.024290:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483016.024305:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.024328:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.024348:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788483016.024351:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483016.024356:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.024361:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad79793 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483016.027168:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483016.027918:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064027776 00000100:00100000:1.0:1788483016.027931:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064027776 00000100:00100000:1.0:1788483016.027996:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:1.0:1788483016.028006:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+7:2354:x1875360064027776:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788483016.028352:0:6660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788483016.028356:0:6660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788483015 -> 1788483014 00002000:00010000:1.0:1788483016.028359:0:6660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788483013 00002000:00010000:1.0:1788483016.028361:0:6660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788483015 -> 1788483014 00002000:00010000:1.0:1788483016.028363:0:6660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788483016.028437:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+8:2354:x1875360064027776:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 430us (1285us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788483016.028445:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:0.0:1788483016.051933:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483016.052081:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064028032 00000100:00100000:3.0:1788483016.052099:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064028032 00000100:00100000:3.0:1788483016.052183:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 185 00000100:00100000:3.0:1788483016.052195:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+18:11512:x1875360064028032:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788483016.052294:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.052313:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 18 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.052323:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.052369:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 18 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.052384:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 18 pid: 6958 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483016.052400:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072413312:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483016.052511:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071ad540 going to sleep for 11 seconds 00000100:00100000:0.0:1788483016.059667:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483016.060968:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072413312:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483016.061001:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483016.065045:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064028160 00000100:00100000:1.0:1788483016.065059:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064028160 00010000:00010000:1.0:1788483016.065112:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 19 pid: 6958 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483016.065184:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:1.0:1788483016.065195:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+19:2353:x1875360064028160:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483016.065211:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483016.065219:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 19 pid: 6958 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065232:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 19 pid: 6958 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065276:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c8b expref: 19 pid: 6958 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065290:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788483016.065296:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065307:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065315:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065342:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483016.065398:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+18:2353:x1875360064028160:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 205us (5740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483016.065406:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00010000:00010000:1.0:1788483016.065436:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065449:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065492:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065498:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065504:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065510:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483016.065514:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065520:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065528:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:1.0:1788483016.065531:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788483016.065534:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.065541:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7979a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483016.065581:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+17:11512:x1875360064028032:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 13389us (13666us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788483016.065590:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 185 00000100:00100000:0.0:1788483016.074671:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483016.074869:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064028288 00000100:00100000:2.0:1788483016.074880:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064028288 00000100:00100000:2.0:1788483016.074943:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:2.0:1788483016.074955:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064028288:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788483016.075000:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.075020:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.075029:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788483016.075033:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483016.075038:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.075073:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.075088:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 8 pid: 6662 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483016.075124:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6662:1875360072413440:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483016.075429:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9011cab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483016.078492:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6662:1875360072413440:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483016.078523:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483016.079307:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483016.079595:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064028416 00000100:00100000:1.0:1788483016.079608:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064028416 00010000:00010000:1.0:1788483016.079669:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483016.079758:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:1.0:1788483016.079777:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360064028416:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483016.079799:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483016.079837:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.079857:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.079894:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a6f398/0x42820277aad7978c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ca7 expref: 9 pid: 6662 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.079920:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788483016.079927:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788483016.079936:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.079951:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.080001:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483016.080078:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064028416:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 306us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483016.080112:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00010000:00010000:3.0:1788483016.080294:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.080315:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.080341:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.080350:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.080358:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.080364:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483016.080368:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.080377:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.080388:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.080395:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad797a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483016.080481:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064028288:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 5528us (5821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483016.080490:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:3.0:1788483016.086170:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483016.086291:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064028672 00000100:00100000:1.0:1788483016.086304:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064028672 00000100:00100000:1.0:1788483016.086383:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 186 00000100:00100000:1.0:1788483016.086394:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+17:11512:x1875360064028672:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788483016.086487:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.086505:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.086517:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.086747:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.086759:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.086767:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.086813:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483016.086827:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 18 pid: 5807 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483016.086856:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918326300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072413568:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788483016.087240:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483016.093984:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483016.093987:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918326300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072413568:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788483016.094021:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483016.098049:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064028800 00000100:00100000:0.0:1788483016.098075:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064028800 00010000:00010000:0.0:1788483016.098150:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 19 pid: 5807 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483016.098237:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:0.0:1788483016.098294:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+19:2351:x1875360064028800:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483016.098311:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483016.098319:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 19 pid: 5807 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.098332:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 19 pid: 5807 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.098360:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c92 expref: 19 pid: 5807 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.098401:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:0.0:1788483016.098410:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.098425:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.098439:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.098498:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483016.098609:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+18:2351:x1875360064028800:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 353us (4631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483016.098627:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00010000:00010000:0.0:1788483016.100026:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.100051:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483016.100380:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788483016.100615:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788483016.100662:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788483016.100857:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f162300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5806:1875360072413696:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788483016.100927:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483016.100968:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483016.101314:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072413696 00000100:00100000:1.0:1788483016.101325:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072413696 00000100:00100000:1.0:1788483016.101397:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788483016.101409:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1875360072413696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788483016.101511:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1875360072413696:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483016.101519:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483016.101979:0:5806:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788483016.101992:0:5806:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb92eb46680, transno 4294967315 00000100:00100000:3.0:1788483016.102031:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f162300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5806:1875360072413696:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788483016.107640:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788483016.107945:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903112680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5806:1875360072413824:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788483016.108052:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483016.109110:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9071adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483016.111385:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072413824 00000100:00100000:2.0:1788483016.111484:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072413824 00000100:00100000:2.0:1788483016.112403:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483016.112414:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1875360072413824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788483016.112712:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5806:x1875360072413824:12345-0@lo:1000:mdt00_000.0 Request processed in 299us (4660us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788483016.112720:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483016.112861:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903112680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5806:1875360072413824:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788483016.112903:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.112914:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.112922:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.112928:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483016.112932:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.112940:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.112967:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb9050b3600) 00010000:00010000:3.0:1788483016.112970:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483016.112974:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.112981:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627a00/0x42820277aad797af lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113007:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113013:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113019:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113024:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483016.113027:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113032:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113039:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3800) 00010000:00010000:3.0:1788483016.113040:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483016.113043:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113048:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626400/0x42820277aad796eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113075:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113089:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113097:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113128:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.113141:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 21 pid: 5806 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483016.113154:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072413952:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483016.113233:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb903867600 going to sleep for 11 seconds 00000100:00100000:0.0:1788483016.121082:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072413952:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788483016.121117:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483016.127639:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483016.127770:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064028928 00000100:00100000:2.0:1788483016.127782:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064028928 00010000:00010000:2.0:1788483016.127824:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 22 pid: 5806 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483016.127871:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:2.0:1788483016.127881:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+22:2352:x1875360064028928:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483016.127895:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483016.127903:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 22 pid: 5806 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.127935:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 22 pid: 5806 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.127955:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077c76 expref: 22 pid: 5806 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.127969:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3800) 00010000:00010000:2.0:1788483016.127974:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.127984:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.127991:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.128013:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483016.128065:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f254000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+21:2352:x1875360064028928:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 186us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483016.128073:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00010000:00010000:0.0:1788483016.128538:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128548:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128559:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128566:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128571:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128576:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483016.128580:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128587:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128596:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3800) 00010000:00010000:0.0:1788483016.128599:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483016.128602:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128608:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128630:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128636:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128641:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128646:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483016.128649:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128655:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128663:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3800) 00010000:00010000:0.0:1788483016.128665:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788483016.128668:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483016.128673:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627c00/0x42820277aad797a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483016.129008:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483016.129013:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483016.129540:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788483016.129554:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788483016.130556:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+20:11512:x1875360064028672:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 44150us (44381us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1788483016.130577:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 186 00000020:00080000:0.0:1788483016.130589:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788483016.143812:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483016.144692:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064029184 00000100:00100000:2.0:1788483016.144704:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064029184 00000100:00100000:2.0:1788483016.144981:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:2.0:1788483016.145000:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918845850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+20:11512:x1875360064029184:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788483016.146018:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788483016.147458:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1788483016.147543:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.147563:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.147577:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.147589:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.147598:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.148168:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483016.148224:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483016.148317:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483016.148324:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.148332:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483016.148336:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.148344:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.148358:0:8489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9eb911fa9400) 00010000:00010000:3.0:1788483016.148369:0:8489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788483016.148375:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.148380:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad797bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483016.148485:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483016.148487:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483016.148489:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483016.148493:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918845850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+22:11512:x1875360064029184:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 3494us (4697us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788483016.148504:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000020:00080000:2.0:1788483016.148510:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788483016.564055:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483016.626654:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072414080:0@lo:400:kworker.0 00000100:00100000:0.0:1788483016.626743:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483016.627907:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072414080 00000100:00100000:2.0:1788483016.627918:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072414080 00000100:00100000:2.0:1788483016.627967:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788483016.627976:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3278:x1875360072414080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.628186:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072414208:0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.628223:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483016.628270:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788483016.628277:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072414336:0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.628300:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483016.628326:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072414208 00000100:00100000:3.0:1788483016.628330:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072414208 00000100:00100000:3.0:1788483016.628354:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072414336 00000100:00100000:3.0:1788483016.628357:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072414336 00000100:00100000:3.0:1788483016.628381:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788483016.628388:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072414208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.628423:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072414208:12345-0@lo:400:kworker.0 Request processed in 35us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483016.628430:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788483016.628458:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788483016.628465:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072414336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.628491:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072414336:12345-0@lo:400:kworker.0 Request processed in 26us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483016.628497:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788483016.628551:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072414336:0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.628563:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072414208:0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.629718:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072414464:0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.629777:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483016.629825:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072414464 00000100:00100000:3.0:1788483016.629832:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072414464 00000100:00100000:3.0:1788483016.629876:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788483016.629885:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875360072414464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483016.629932:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875360072414464:12345-0@lo:400:kworker.0 Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483016.629940:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788483016.629980:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072414464:0@lo:400:kworker.0 00000100:00080000:3.0:1788483016.630009:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483016.637951:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3278:x1875360072414080:12345-0@lo:400:kworker.0 Request processed in 9594us (10827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483016.637983:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788483016.639618:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072414080:0@lo:400:kworker.0 00000100:00100000:1.0:1788483016.639898:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483016.639913:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072414592:0@lo:400:kworker.0 00000100:00100000:1.0:1788483016.639996:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483016.640048:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072414592 00000100:00100000:1.0:1788483016.640054:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072414592 00000100:00100000:1.0:1788483016.640109:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788483016.640119:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072414592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483016.640177:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072414592:12345-0@lo:400:kworker.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483016.640184:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788483016.640212:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483016.640235:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072414592:0@lo:400:kworker.0 00000001:00080000:3.0:1788483016.694782:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1788483016.694802:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788483016.694817:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788483017.139058:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072414720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483017.139149:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483017.139416:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072414720 00000100:00100000:0.0:1788483017.139426:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072414720 00000100:00100000:0.0:1788483017.139496:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788483017.139507:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072414720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483017.139549:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483017.139639:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072414720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483017.139647:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788483017.139919:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788483017.139927:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788483017.139955:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb93f1ba300, transno 4294967307 00000100:00100000:1.0:1788483017.139989:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072414720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788483017.591344:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483018.019334:0:12487:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483018.019344:0:12487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483018.019545:0:12487:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788483018.019551:0:12487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483018.169949:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072414848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483018.170027:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483018.170141:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072414848 00000100:00100000:0.0:1788483018.170150:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072414848 00000100:00100000:0.0:1788483018.170218:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788483018.170229:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875360072414848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483018.170286:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483018.170344:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875360072414848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483018.170351:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788483018.170453:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483018.170490:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072414848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483018.207061:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.207105:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064029440 00000100:00100000:3.0:1788483018.207118:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064029440 00000100:00100000:3.0:1788483018.207195:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00100000:3.0:1788483018.207207:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+22:2351:x1875360064029440:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483018.207341:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+22:2351:x1875360064029440:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 136us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.207362:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 161 00000100:00080000:1.0:1788483018.209805:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483018.214190:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.214240:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.214287:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.214303:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.214325:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.214588:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064029312 00000100:00100000:3.0:1788483018.214599:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064029312 00000100:00100000:3.0:1788483018.214659:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 299 00000100:00100000:3.0:1788483018.214670:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360064029312:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483018.214759:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360064029312:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 91us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.214768:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 299 00000100:00100000:3.0:1788483018.214803:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064029568 00000100:00100000:3.0:1788483018.214807:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064029568 00000100:00100000:3.0:1788483018.214841:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064029696 00000100:00100000:3.0:1788483018.214844:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064029696 00000100:00100000:3.0:1788483018.214865:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:3.0:1788483018.214871:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064029568:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483018.214915:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064029568:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 42us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.214922:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:3.0:1788483018.214936:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:3.0:1788483018.214942:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360064029696:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483018.214965:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2351:x1875360064029696:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.214970:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:3.0:1788483018.214988:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064029824 00000100:00100000:3.0:1788483018.214991:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064029824 00000100:00100000:3.0:1788483018.215017:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064030080 00000100:00100000:3.0:1788483018.215030:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064030080 00000100:00100000:3.0:1788483018.215055:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:3.0:1788483018.215061:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360064029824:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483018.215090:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360064029824:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 30us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.215097:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 162 00000100:00100000:3.0:1788483018.215109:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 187 00000100:00100000:3.0:1788483018.215116:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+22:11530:x1875360064030080:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483018.215126:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.215147:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cae expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.215857:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad797cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.215875:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad797cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.215889:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad797cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483018.215903:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1788483018.216093:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cae expref: 25 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.216112:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad797cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cae expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.216122:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483018.216131:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788483018.216135:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493000, rc 0) 00000100:00100000:3.0:1788483018.216189:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+24:11530:x1875360064030080:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1072us (1883us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788483018.216235:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 187 00000100:00080000:3.0:1788483018.216296:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483018.216301:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483018.216303:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483018.227215:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.231716:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064030208 00000100:00100000:3.0:1788483018.231733:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064030208 00000100:00100000:3.0:1788483018.231806:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 188 00000100:00100000:3.0:1788483018.231817:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+24:11530:x1875360064030208:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1788483018.231900:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.231918:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.231929:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.231957:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.231965:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.231972:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232335:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232361:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232369:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483018.232427:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232440:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232445:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232451:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232457:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483018.232461:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232468:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.232480:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483018.232484:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483018.233102:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233111:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233135:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233141:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233147:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233152:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483018.233155:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233161:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233170:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9231eb100) 00010000:00010000:3.0:1788483018.233173:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483018.233176:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233182:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233200:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233206:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233212:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233223:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483018.233227:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233233:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233242:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb200) 00010000:00010000:3.0:1788483018.233244:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483018.233324:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.233331:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.233541:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+24:11530:x1875360064030208:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1723us (6338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.233552:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 188 00000100:00100000:1.0:1788483018.279399:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.279493:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064030464 00000100:00100000:3.0:1788483018.279504:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064030464 00000100:00100000:3.0:1788483018.279570:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 189 00000100:00100000:3.0:1788483018.279581:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+24:11533:x1875360064030464:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483018.279600:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.279619:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cb5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279692:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279723:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279734:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279746:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279751:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279755:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279989:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279995:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.279999:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483018.280004:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788483018.280342:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280348:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280354:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280366:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483018.280370:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280377:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280388:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483018.280391:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483018.280395:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280401:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad797f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280426:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280432:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280439:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280444:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483018.280451:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280456:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280475:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9231eb200) 00010000:00010000:3.0:1788483018.280478:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483018.280481:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280487:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad797fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280530:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad797ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280542:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.280550:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:3.0:1788483018.280552:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483018.280559:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb900030e00, rc 0) 00000100:00100000:3.0:1788483018.280616:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+26:11533:x1875360064030464:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1037us (1228us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788483018.280623:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 189 00000100:00100000:1.0:1788483018.284540:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.284665:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064030592 00000100:00100000:0.0:1788483018.284676:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064030592 00000100:00100000:0.0:1788483018.284761:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:0.0:1788483018.284773:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+26:11533:x1875360064030592:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:0.0:1788483018.284850:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284869:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284881:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284908:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284915:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284921:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284927:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.284931:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284939:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284952:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:0.0:1788483018.284955:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483018.284961:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.284978:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.285793:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+26:11533:x1875360064030592:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 1017us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483018.285803:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 190 00000100:00100000:1.0:1788483018.288634:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.288735:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064030848 00000100:00100000:3.0:1788483018.288748:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064030848 00000100:00100000:3.0:1788483018.288822:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:3.0:1788483018.288834:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+26:11533:x1875360064030848:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:3.0:1788483018.289434:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+27:11533:x1875360064030848:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 599us (806us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788483018.289443:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:1.0:1788483018.336535:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.336648:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064031104 00000100:00100000:3.0:1788483018.336665:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064031104 00000100:00100000:3.0:1788483018.336823:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 191 00000100:00100000:3.0:1788483018.336839:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+27:11058:x1875360064031104:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788483018.336878:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.336908:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79818 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cbc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.337031:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.337061:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.337072:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.337118:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.337135:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 28 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.337153:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072414976:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483018.337333:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90313e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788483018.345469:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.345629:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072414976:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483018.345666:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.346180:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064031232 00000100:00100000:0.0:1788483018.346188:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064031232 00010000:00010000:0.0:1788483018.346226:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 29 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.346425:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1788483018.346436:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+29:2352:x1875360064031232:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483018.346450:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483018.346457:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 29 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.346471:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 29 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.346492:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb900030e00/0x42820277aad79803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cb5 expref: 29 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.346511:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:0.0:1788483018.346516:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.346537:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.346546:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.346763:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483018.346827:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+28:2352:x1875360064031232:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 392us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483018.346836:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00010000:00010000:3.0:1788483018.347333:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.347343:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483018.347437:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788483018.347616:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad79818 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.347879:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.347890:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:3.0:1788483018.347892:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788483018.347895:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901493400, rc 0) 00000100:00100000:3.0:1788483018.347961:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+28:11058:x1875360064031104:12345-192.168.201.6@tcp:101:bash.0 Request processed in 11126us (11437us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788483018.347971:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 191 00000100:00100000:1.0:1788483018.351696:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.351832:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064031488 00000100:00100000:3.0:1788483018.351843:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064031488 00000100:00100000:3.0:1788483018.351904:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 192 00000100:00100000:3.0:1788483018.351915:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+28:11058:x1875360064031488:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:3.0:1788483018.352593:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.352615:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.352720:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483018.352792:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1788483018.352821:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b09f4d5 reply state 000000002a464f6f transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.352831:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788483018.352892:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1788483018.353576:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+32:11058:x1875360064031488:12345-192.168.201.6@tcp:36:bash.0 Request processed in 1657us (1883us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788483018.353587:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 192 00000020:00080000:3.0:1788483018.353596:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788483018.358790:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:0.0:1788483018.358969:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.358983:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.358991:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.358996:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.359001:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.359010:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.359025:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:0.0:1788483018.359028:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483018.359033:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.359070:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492a00/0x42820277aad7982d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.359544:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064031616 00000100:00100000:3.0:1788483018.359558:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064031616 00000100:00100000:3.0:1788483018.359627:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 193 00000100:00100000:3.0:1788483018.359638:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+31:11058:x1875360064031616:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788483018.359662:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.359681:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cc3 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.359747:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cc3 expref: 32 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.359762:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cc3 expref: 32 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.359782:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:3.0:1788483018.359794:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483018.359797:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492800, rc 0) 00000100:00100000:3.0:1788483018.359874:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+32:11058:x1875360064031616:12345-192.168.201.6@tcp:101:bash.0 Request processed in 237us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.359881:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 193 00000100:00100000:2.0:1788483018.368567:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.368647:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064031744 00000100:00100000:3.0:1788483018.368656:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064031744 00000100:00100000:3.0:1788483018.368711:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:3.0:1788483018.368723:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:11058:x1875360064031744:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788483018.368744:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.368767:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cca expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483018.368798:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9a15c6, atime: 0x6a9a15c5, ctime: 0x6a9a15c6, blocks: 0xb 00010000:00010000:3.0:1788483018.368818:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1788483018.368821:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483018.368828:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.368842:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 8 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.368852:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb901492a00, rc 0) 00000100:00100000:3.0:1788483018.368911:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+8:11058:x1875360064031744:12345-192.168.201.6@tcp:101:bash.0 Request processed in 192us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.368917:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:1.0:1788483018.371640:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.371763:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064031872 00000100:00100000:0.0:1788483018.371776:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064031872 00002000:00010000:0.0:1788483018.371829:0:6667:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788483018.371833:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb92e958000 with x1875360064031872 ext(0->18446744073709551615) 00002000:00010000:0.0:1788483018.371846:0:6667:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb92e958000. 00000100:00100000:0.0:1788483018.371882:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1788483018.371895:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa30c745-265d-4a44-8753-67e411452897+8:2351:x1875360064031872:12345-192.168.201.6@tcp:10:bash.0 00002000:00010000:0.0:1788483018.372202:0:6667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788483018.372205:0:6667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788483014 -> 1788483018 00002000:00010000:0.0:1788483018.372207:0:6667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788483013 -> 1788483013 00002000:00010000:0.0:1788483018.372209:0:6667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788483014 -> 1788483018 00002000:00010000:0.0:1788483018.372210:0:6667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788483018.372838:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa30c745-265d-4a44-8753-67e411452897+9:2351:x1875360064031872:12345-192.168.201.6@tcp:10:bash.0 Request processed in 939us (1205us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788483018.372849:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00002000:00010000:0.0:1788483018.372855:0:6667:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1788483018.372859:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb92e958000 with x1875360064031872 ext(0->18446744073709551615) 00002000:00010000:0.0:1788483018.372867:0:6667:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb92e958000. 00000100:00100000:3.0:1788483018.462336:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.462629:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064032000 00000100:00100000:0.0:1788483018.462656:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064032000 00000100:00100000:0.0:1788483018.462740:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:0.0:1788483018.462754:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+32:11547:x1875360064032000:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:0.0:1788483018.462871:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.462893:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.462906:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.463111:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.463120:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.463127:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465705:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465732:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465744:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483018.465808:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465824:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465843:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465851:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465858:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.465863:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465871:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465886:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483018.465889:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483018.465895:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465901:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465927:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465934:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465941:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465946:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.465954:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465961:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465969:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb907174a00) 00010000:00010000:0.0:1788483018.465972:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483018.465975:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465981:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79849 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.465998:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.466004:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.466010:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.466016:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.466019:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.466025:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.466033:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:0.0:1788483018.466049:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483018.466061:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.466067:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.466185:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+32:11547:x1875360064032000:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 3426us (3854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483018.466198:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 194 00000100:00100000:2.0:1788483018.513169:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.513303:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064032256 00000100:00100000:3.0:1788483018.513314:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064032256 00000100:00100000:3.0:1788483018.513388:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 195 00000100:00100000:3.0:1788483018.513400:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+32:11550:x1875360064032256:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483018.513436:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.513480:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cd1 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.513558:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.513573:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.513584:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.513598:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.513605:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.513611:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514532:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7986c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514546:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514562:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483018.514573:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788483018.514745:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514754:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514760:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514767:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483018.514772:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514779:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514793:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483018.514796:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483018.514801:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514807:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7985e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514822:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514828:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514842:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514847:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483018.514849:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514855:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514863:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9231ebb00) 00010000:00010000:3.0:1788483018.514865:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483018.514867:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514873:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14600/0x42820277aad79865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514918:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cd1 expref: 35 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514932:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7986c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cd1 expref: 34 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.514938:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:3.0:1788483018.514940:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788483018.514943:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14000, rc 0) 00000100:00100000:3.0:1788483018.515014:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+34:11550:x1875360064032256:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1616us (1854us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788483018.516960:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 195 00000100:00100000:1.0:1788483018.520218:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.520684:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064032384 00000100:00100000:3.0:1788483018.520697:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064032384 00000100:00100000:3.0:1788483018.520769:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:3.0:1788483018.520782:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92e958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+34:11550:x1875360064032384:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1788483018.520863:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.520885:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.520896:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.520937:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.520951:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 34 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.520966:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918326300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072415104:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483018.521285:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90313e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483018.532792:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918326300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072415104:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483018.532831:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483018.533732:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483018.533839:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064032640 00000100:00100000:2.0:1788483018.533848:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064032640 00000100:00100000:2.0:1788483018.533944:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:2.0:1788483018.533955:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+35:5592:x1875360064032640:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788483018.534375:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+36:5592:x1875360064032640:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 420us (644us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788483018.534383:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1788483018.537968:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483018.538074:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064032768 00000100:00100000:2.0:1788483018.538086:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064032768 00010000:00010000:2.0:1788483018.538129:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 36 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483018.538173:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:2.0:1788483018.538184:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9243b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+36:2351:x1875360064032768:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483018.538200:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483018.538208:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 36 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.538221:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 36 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.538700:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493400/0x42820277aad7981f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cbc expref: 36 pid: 5807 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.538722:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:2.0:1788483018.538728:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.538738:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.538746:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.538829:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483018.538888:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9243b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+35:2351:x1875360064032768:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 706us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483018.538897:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00010000:00010000:3.0:1788483018.541185:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.541231:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.542193:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.542208:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.542218:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.542226:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483018.542232:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.542480:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.542502:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:2.0:1788483018.542506:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483018.542511:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.542517:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad7987a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483018.542694:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92e958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+34:11550:x1875360064032384:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 21906us (22478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483018.542711:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 196 00000100:00100000:0.0:1788483018.545948:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483018.546131:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064033024 00000100:00100000:1.0:1788483018.546143:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064033024 00000100:00100000:1.0:1788483018.546233:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:1.0:1788483018.546244:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+34:11550:x1875360064033024:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788483018.546524:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+35:11550:x1875360064033024:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 281us (587us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788483018.546532:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00010000:00010000:3.0:1788483018.610545:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483018.635086:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.640003:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064033280 00000100:00100000:0.0:1788483018.640020:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064033280 00000100:00100000:0.0:1788483018.640106:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 197 00000100:00100000:0.0:1788483018.640119:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+35:11561:x1875360064033280:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1788483018.640146:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483018.640171:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79881 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cd8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640272:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640286:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640297:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640312:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640335:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640342:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640635:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640645:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640652:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483018.640662:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788483018.640742:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640749:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640756:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640762:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.640766:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640773:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640794:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483018.640797:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483018.640801:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640807:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79888 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640821:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640826:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640832:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640837:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.640840:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640846:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640851:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb907174a00) 00010000:00010000:0.0:1788483018.640854:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483018.640856:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640917:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7988f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640965:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad79881 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cd8 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640977:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cd8 expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.640985:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:0.0:1788483018.640987:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483018.640990:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369200, rc 0) 00000100:00100000:0.0:1788483018.641064:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+37:11561:x1875360064033280:12345-192.168.201.6@tcp:101:cat.0 Request processed in 947us (5989us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788483018.641071:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 197 00000100:00100000:0.0:1788483018.645013:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483018.645140:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064033536 00000100:00100000:2.0:1788483018.645152:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064033536 00000100:00100000:2.0:1788483018.645439:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:2.0:1788483018.645452:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+37:11561:x1875360064033536:12345-192.168.201.6@tcp:35:cat.0 00000100:00100000:2.0:1788483018.646963:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+38:11561:x1875360064033536:12345-192.168.201.6@tcp:35:cat.0 Request processed in 1506us (1954us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788483018.646973:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1788483018.667794:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.668065:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064033792 00000100:00100000:0.0:1788483018.668084:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064033792 00000100:00100000:0.0:1788483018.668359:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 198 00000100:00100000:0.0:1788483018.668369:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+38:11562:x1875360064033792:12345-192.168.201.6@tcp:36:rm.0 00010000:00010000:0.0:1788483018.668455:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788483018.668487:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad79896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cd8 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.668513:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7986c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cd1 expref: 37 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.668525:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492800/0x42820277aad79834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cc3 expref: 36 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.668551:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9231eb100) 00010000:00010000:0.0:1788483018.668565:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788483018.668587:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.668600:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.668612:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.668625:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.668751:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.668756:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.674814:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.674836:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.674849:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483018.676335:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788483018.676348:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335842098269ns, next at 336842095816ns, rc = 0 00010000:00010000:1.0:1788483018.676631:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676646:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676656:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676664:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676671:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676677:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676702:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483018.676723:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483018.676726:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.676730:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676744:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676749:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.676750:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483018.676754:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.676755:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676758:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.676762:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676763:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676777:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3200) 00010000:00010000:1.0:1788483018.676779:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788483018.676784:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.676784:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9eb9050b3200) 00010000:00010000:0.0:1788483018.676787:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788483018.676790:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad798b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.676790:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.676796:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627600/0x42820277aad798b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676809:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.676810:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483018.676812:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483018.676814:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483018.676815:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676821:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676826:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483018.676834:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676840:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.676849:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:1.0:1788483018.676852:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483018.677012:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.677020:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad798a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483018.677032:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa44fe05 reply state 00000000ec76c76a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483018.677041:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483018.677142:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+37:11562:x1875360064033792:12345-192.168.201.6@tcp:36:rm.0 Request processed in 8770us (9356us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788483018.677151:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 198 00010000:00010000:1.0:1788483018.684308:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.684330:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.684341:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.684347:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483018.684352:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.684377:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.684396:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb907174a00) 00010000:00010000:1.0:1788483018.684399:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483018.684404:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.684420:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad798ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483018.744244:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483018.744533:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064034048 00000100:00100000:0.0:1788483018.744550:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064034048 00000100:00100000:0.0:1788483018.744627:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 199 00000100:00100000:0.0:1788483018.744638:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+36:11568:x1875360064034048:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788483018.744666:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483018.744689:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad798c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cdf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.744843:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.744859:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.744870:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.744883:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.745099:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.745106:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788483018.745839:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788483018.746173:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746186:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746195:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746232:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746240:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746290:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746297:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483018.746302:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746310:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746334:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483018.746337:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483018.746343:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.746348:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad798c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788483018.746362:0:5807:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003671bb62 reply state 000000003f6c85cf transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.747691:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788483018.747751:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad798c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.747774:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.747782:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:0.0:1788483018.747786:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483018.747789:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369c00, rc 0) 00000100:00100000:0.0:1788483018.747944:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+39:11568:x1875360064034048:12345-192.168.201.6@tcp:101:bash.0 Request processed in 3306us (3711us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788483018.747953:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 199 00000100:00100000:0.0:1788483018.753535:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:1.0:1788483018.753650:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.753664:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.753672:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.753678:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483018.753683:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.753690:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.753707:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb907174500) 00010000:00010000:1.0:1788483018.753710:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483018.753730:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.753737:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369000/0x42820277aad798ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.753950:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064034176 00000100:00100000:3.0:1788483018.754063:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064034176 00000100:00100000:3.0:1788483018.754126:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:3.0:1788483018.754139:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360064034176:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788483018.754164:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.754186:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ce6 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788483018.754217:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788483018.754243:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1788483018.754330:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483018.754342:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.754363:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.754499:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15000, rc 0) 00000100:00100000:3.0:1788483018.754564:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064034176:12345-192.168.201.6@tcp:101:bash.0 Request processed in 428us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.754570:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:1.0:1788483018.765294:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.765356:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064034304 00000100:00100000:3.0:1788483018.765374:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064034304 00000100:00100000:3.0:1788483018.765442:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:3.0:1788483018.765453:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+6:11568:x1875360064034304:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788483018.765469:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.765485:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ced expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.765511:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.765517:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483018.765521:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483018.765524:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.765553:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.765563:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 7 pid: 6660 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.765575:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918325880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6663:1875360072415232:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483018.765673:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90313e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483018.770931:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918325880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6663:1875360072415232:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788483018.771692:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:3.0:1788483018.771914:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 7 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.771968:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14600, rc 0) 00000100:00100000:3.0:1788483018.772054:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:11568:x1875360064034304:12345-192.168.201.6@tcp:101:bash.0 Request processed in 6600us (6768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.772065:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:0.0:1788483018.772347:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064034432 00000100:00100000:0.0:1788483018.772360:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064034432 00010000:00010000:0.0:1788483018.772436:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 7 pid: 6660 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.772494:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:0.0:1788483018.772505:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064034432:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483018.772522:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483018.772552:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 7 pid: 6660 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.772566:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 7 pid: 6660 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.772594:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc114345/0x42820277aad798e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ce6 expref: 7 pid: 6660 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.772612:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483018.772618:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483018.772629:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.772642:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.772683:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.772700:0:5795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5795:1875360072415360:192.168.201.6@tcp:105: 00000100:00100000:0.0:1788483018.772787:0:5795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483018.777455:0:5795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056dd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5795:1875360072415360:192.168.201.6@tcp:105: 00010000:00010000:0.0:1788483018.777499:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483018.777584:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064034432:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 5077us (5954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483018.777600:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:1.0:1788483018.782888:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483018.783135:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064034688 00000100:00100000:2.0:1788483018.783150:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064034688 00000100:00100000:2.0:1788483018.783227:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1788483018.783241:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+38:11568:x1875360064034688:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:2.0:1788483018.783801:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+39:11568:x1875360064034688:12345-192.168.201.6@tcp:35:bash.0 Request processed in 558us (921us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788483018.783838:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:1.0:1788483018.943069:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483018.943179:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064034816 00000100:00100000:2.0:1788483018.943192:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064034816 00000100:00100000:2.0:1788483018.943299:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:2.0:1788483018.943313:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+39:11584:x1875360064034816:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483018.943341:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483018.943364:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad798f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cf4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.943455:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad798f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.943475:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad798f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.943488:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad798f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483018.943553:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788483018.943558:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483018.943584:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad798f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.943615:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad798f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cf4 expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.943636:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad798f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cf4 expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.943669:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:2.0:1788483018.943672:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483018.943676:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66e00, rc 0) 00000100:00100000:2.0:1788483018.943749:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+40:11584:x1875360064034816:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 440us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483018.943756:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 200 00000100:00100000:0.0:1788483018.951540:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.951658:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064035072 00000100:00100000:3.0:1788483018.951672:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064035072 00000100:00100000:3.0:1788483018.951777:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 201 00000100:00100000:3.0:1788483018.951789:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+40:11584:x1875360064035072:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483018.951811:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483018.951833:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad798ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077cfb expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.951952:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad79906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.951967:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad79906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.951980:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad79906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483018.951993:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788483018.952164:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad798ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cfb expref: 43 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.952185:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad79906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cfb expref: 42 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.952217:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:3.0:1788483018.952221:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483018.952224:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15200, rc 0) 00000100:00100000:3.0:1788483018.952356:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+42:11584:x1875360064035072:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 569us (829us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788483018.952364:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 201 00000100:00100000:0.0:1788483018.959953:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483018.960068:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064035328 00000100:00100000:2.0:1788483018.960080:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064035328 00000100:00100000:2.0:1788483018.960145:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:2.0:1788483018.960157:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+42:11584:x1875360064035328:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483018.960183:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483018.960207:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d02 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.960374:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad7991b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.960391:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad7991b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.960410:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad7991b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483018.960423:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788483018.960554:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d02 expref: 45 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.960596:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad7991b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d02 expref: 44 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.960606:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:2.0:1788483018.960609:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788483018.960613:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66200, rc 0) 00000100:00100000:2.0:1788483018.960941:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+44:11584:x1875360064035328:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 785us (997us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788483018.960950:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 202 00000100:00100000:1.0:1788483018.970100:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483018.971669:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483018.971811:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064035584 00000100:00100000:3.0:1788483018.971824:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064035584 00000100:00100000:3.0:1788483018.971893:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:3.0:1788483018.971905:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93b172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+6:2352:x1875360064035584:12345-192.168.201.6@tcp:1:lfs.0 00010000:00010000:3.0:1788483018.971951:0:12045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.971972:0:12045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.971981:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788483018.971986:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483018.971992:0:12045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.972031:0:12045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 6 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.972046:0:12045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 6 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.972076:0:12045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918325880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12045:1875360072415488:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483018.972182:0:12045:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90313e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788483018.973067:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064035456 00000100:00100000:0.0:1788483018.973078:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064035456 00000100:00100000:0.0:1788483018.973152:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1788483018.973174:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+44:2353:x1875360064035456:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483018.973190:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483018.973219:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad79906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cfb expref: 44 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483018.973243:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:0.0:1788483018.973299:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483018.973362:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+43:2353:x1875360064035456:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 190us (3275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483018.973379:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1788483018.975906:0:12045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918325880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12045:1875360072415488:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483018.975941:0:12045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.978595:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483018.979178:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064035712 00000100:00100000:1.0:1788483018.979194:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064035712 00002000:00100000:1.0:1788483018.979318:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9eb9056dc700 x1875360064035712/t0(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:524/0 lens 504/0 e 0 to 0 dl 1788483029 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483018.979329:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb9056dc700 with x1875360064035712 ext(0->8) 00010000:00010000:1.0:1788483018.979353:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 7 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.979377:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 7 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483018.979386:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eb9056dc700 00000100:00100000:1.0:1788483018.979423:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:1.0:1788483018.979434:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064035712:12345-192.168.201.6@tcp:4:lfs.0 00000100:00100000:1.0:1788483018.980087:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+9:2351:x1875360064035712:12345-192.168.201.6@tcp:4:lfs.0 Request processed in 652us (1500us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788483018.980096:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00002000:00100000:1.0:1788483018.980113:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9eb9056dc700 x1875360064035712/t4294967308(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:524/0 lens 504/448 e 0 to 0 dl 1788483029 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483018.980122:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb9056dc700 with x1875360064035712 ext(0->8) 00010000:00010000:1.0:1788483018.980129:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 9 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483018.980144:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 9 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483018.984741:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00002000:00010000:1.0:1788483018.985464:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9eb9056dc700 00000100:00100000:2.0:1788483018.985575:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064035840 00000100:00100000:2.0:1788483018.985586:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064035840 00010000:00010000:2.0:1788483018.985638:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 9 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483018.985682:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:2.0:1788483018.985693:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360064035840:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483018.985707:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788483018.985728:0:5794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788483018.985731:0:5794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788483018 00002000:00010000:2.0:1788483018.985733:0:5794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788483019 00002000:00010000:2.0:1788483018.985735:0:5794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788483018 00010000:00010000:2.0:1788483018.985741:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 9 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.985773:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 9 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.985797:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e09bcec9/0x42820277aad798ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ced expref: 9 pid: 6663 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.985812:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483018.985817:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483018.985822:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.985831:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.985854:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483018.985914:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064035840:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 223us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483018.985922:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00010000:00010000:3.0:1788483018.987559:0:12045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.987582:0:12045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.987640:0:12045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.987650:0:12045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.987660:0:12045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.987667:0:12045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483018.987672:0:12045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.987706:0:12045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.987728:0:12045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483018.987736:0:12045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7d37c1e/0x42820277aad79929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483018.987857:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93b172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064035584:12345-192.168.201.6@tcp:1:lfs.0 Request processed in 15948us (16192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483018.987868:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:0.0:1788483018.995218:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483018.995606:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064036096 00000100:00100000:2.0:1788483018.995617:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064036096 00000100:00100000:2.0:1788483018.995691:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:2.0:1788483018.995703:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918845050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+43:11584:x1875360064036096:12345-192.168.201.6@tcp:35:lfs.0 00000004:00010000:2.0:1788483018.995765:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad7991b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d02 expref: 43 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483018.996050:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788483018.996095:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788483018.996845:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1788483018.996910:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.996928:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 47 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.996937:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.996972:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 47 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483018.996988:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 47 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483018.997006:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d18380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1875360072415616:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483018.997168:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483019.001671:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483019.001798:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064036224 00000100:00100000:0.0:1788483019.001808:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064036224 00010000:00010000:0.0:1788483019.001847:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 48 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483019.001901:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:0.0:1788483019.001911:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+48:2352:x1875360064036224:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483019.001927:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483019.001934:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 48 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.001948:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 48 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.001969:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:0.0:1788483019.001975:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.001984:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.001992:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.002010:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483019.002068:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+48:2352:x1875360064036224:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 158us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483019.002075:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00010000:00010000:2.0:1788483019.003553:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad798d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cdf expref: 47 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.003576:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d18380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1875360072415616:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483019.003599:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.003702:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.003708:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483019.003860:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1788483019.004093:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788483019.004541:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d18380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1875360072415744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788483019.004609:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483019.004657:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217ddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788483019.004792:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072415744 00000100:00100000:1.0:1788483019.004800:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072415744 00000100:00100000:1.0:1788483019.004874:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788483019.004885:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5811:x1875360072415744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788483019.004982:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5811:x1875360072415744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483019.004989:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788483019.005030:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d18380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1875360072415744:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788483019.005748:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788483019.005991:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788483019.006068:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1875360072415872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788483019.006109:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483019.006184:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb923106f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483019.006789:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072415872 00000100:00100000:2.0:1788483019.006798:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072415872 00000100:00100000:2.0:1788483019.006892:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788483019.006903:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5811:x1875360072415872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788483019.007102:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875360072415872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 200us (990us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788483019.007109:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788483019.007191:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1875360072415872:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788483019.007272:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788483019.007358:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483019.007369:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483019.007378:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483019.007384:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483019.007389:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483019.007396:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483019.007421:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:1.0:1788483019.007424:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788483019.007429:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483019.007435:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66000/0x42820277aad79930 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788483019.007643:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788483019.007738:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788483019.007747:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336173497181ns, next at 337173495395ns, rc = 0 00000001:00080000:1.0:1788483019.007753:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788483019.007786:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174d00) 00010000:00010000:1.0:1788483019.007790:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788483019.007797:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66200/0x42820277aad7991b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d02 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483019.007926:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918845050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+50:11584:x1875360064036096:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 12224us (12720us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788483019.007934:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000020:00080000:1.0:1788483019.007939:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788483019.012070:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483019.012187:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064036352 00000100:00100000:0.0:1788483019.012201:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064036352 00000100:00100000:0.0:1788483019.012287:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 203 00000100:00100000:0.0:1788483019.012298:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+50:11584:x1875360064036352:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788483019.012357:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483019.012388:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d09 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.012463:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d09 expref: 51 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.012476:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d09 expref: 51 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.012496:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788483019.012499:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483019.012503:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368400, rc 0) 00000100:00100000:0.0:1788483019.012567:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+51:11584:x1875360064036352:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 270us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483019.012575:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 203 00000100:00100000:3.0:1788483019.017044:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483019.017507:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064036608 00000100:00100000:1.0:1788483019.017519:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064036608 00000100:00100000:1.0:1788483019.017592:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1788483019.017603:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+51:11584:x1875360064036608:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788483019.018002:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+52:11584:x1875360064036608:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 400us (969us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788483019.018010:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1788483019.119798:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483019.119912:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064036736 00000100:00100000:3.0:1788483019.119923:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064036736 00000100:00100000:3.0:1788483019.120042:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:3.0:1788483019.120056:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+52:11594:x1875360064036736:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1788483019.120142:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120162:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120176:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120214:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120220:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120224:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120359:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120369:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120376:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483019.120432:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120444:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120449:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120455:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120460:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483019.120463:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120474:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120484:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483019.120487:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483019.120490:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120493:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad7993e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120504:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120507:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120511:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120514:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483019.120515:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120518:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120522:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9231ebb00) 00010000:00010000:3.0:1788483019.120523:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483019.120525:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120534:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120547:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120550:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120554:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120558:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483019.120559:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120562:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120566:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788483019.120567:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483019.120569:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.120572:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7994c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483019.120657:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+52:11594:x1875360064036736:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 603us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.120665:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 204 00000100:00100000:0.0:1788483019.161572:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483019.161774:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064036992 00000100:00100000:3.0:1788483019.161787:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064036992 00000100:00100000:3.0:1788483019.161880:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 205 00000100:00100000:3.0:1788483019.161895:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+52:11597:x1875360064036992:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483019.162117:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483019.162145:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad79953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.162310:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.162329:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.162506:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.162527:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.162535:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.162542:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163235:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163286:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163313:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483019.163328:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788483019.163826:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163837:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163845:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163853:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483019.163858:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163879:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163897:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483019.163900:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483019.163905:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.163912:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad7995a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165084:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165101:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165126:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165132:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483019.165136:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165144:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165163:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9231ebb00) 00010000:00010000:3.0:1788483019.165167:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483019.165170:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165176:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165292:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad79953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165309:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.165318:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788483019.165320:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483019.165322:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14800, rc 0) 00000100:00100000:3.0:1788483019.171148:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+54:11597:x1875360064036992:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 9243us (9572us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788483019.171180:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 205 00000100:00100000:1.0:1788483019.188459:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483019.188564:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064037120 00000100:00100000:2.0:1788483019.188576:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064037120 00000100:00100000:2.0:1788483019.188680:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:2.0:1788483019.188691:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+54:11597:x1875360064037120:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:2.0:1788483019.188764:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.188783:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.188816:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.188849:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.188857:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.191294:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.191303:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483019.191308:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.191318:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.191338:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483019.191342:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483019.191347:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.191354:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad79976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.191490:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+54:11597:x1875360064037120:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 2795us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.191502:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 206 00000100:00100000:1.0:1788483019.194908:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483019.195123:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064037376 00000100:00100000:2.0:1788483019.195145:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064037376 00000100:00100000:2.0:1788483019.195210:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:2.0:1788483019.195221:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+54:11597:x1875360064037376:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788483019.195514:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+55:11597:x1875360064037376:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 294us (616us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788483019.195522:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:0.0:1788483019.264734:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483019.264806:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064037632 00000100:00100000:3.0:1788483019.264817:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064037632 00000100:00100000:3.0:1788483019.264888:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 207 00000100:00100000:3.0:1788483019.264900:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+55:11607:x1875360064037632:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788483019.264923:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483019.264926:0:6958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788483019.264948:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66e00/0x42820277aad798f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cf4 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.264964:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483019.264967:0:6958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483019.264978:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7997d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d17 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.265074:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.265083:0:6958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.265089:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.265116:0:6958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.265126:0:6958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 55 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483019.265149:0:6958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb918324a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072416000:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483019.265285:0:6958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90313e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788483019.268289:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483019.268748:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064037760 00000100:00100000:2.0:1788483019.268759:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064037760 00010000:00010000:2.0:1788483019.268800:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 56 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.268845:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:2.0:1788483019.268855:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+56:2351:x1875360064037760:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483019.268870:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483019.268877:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 56 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.268891:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 56 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.268912:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483019.268918:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.268926:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.268934:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.268965:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483019.269026:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+56:2351:x1875360064037760:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 172us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.269033:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00010000:00010000:3.0:1788483019.269274:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79968 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d10 expref: 55 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483019.269293:0:6958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb918324a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072416000:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483019.269318:0:6958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.269329:0:6958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.269348:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483019.269370:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788483019.269550:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad7997d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 56 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.269566:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 55 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.269574:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788483019.269577:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788483019.269580:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15a00, rc 0) 00000100:00100000:3.0:1788483019.269614:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+55:11607:x1875360064037632:12345-192.168.201.6@tcp:101:bash.0 Request processed in 4717us (4897us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788483019.269768:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 207 00000100:00100000:1.0:1788483019.272645:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483019.272808:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064038016 00000100:00100000:3.0:1788483019.272820:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064038016 00000100:00100000:3.0:1788483019.272879:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 208 00000100:00100000:3.0:1788483019.272890:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+55:11607:x1875360064038016:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:3.0:1788483019.273151:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.273167:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.273179:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483019.273230:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:3.0:1788483019.273551:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023448137 reply state 00000000b1b7738a transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483019.273561:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483019.273824:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+58:11607:x1875360064038016:12345-192.168.201.6@tcp:36:bash.0 Request processed in 933us (1186us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788483019.273833:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 208 00000020:00080000:3.0:1788483019.273838:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788483019.276081:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.276100:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.276107:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.276114:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483019.276119:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.276143:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.276462:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788483019.276466:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483019.276471:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.276478:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14c00/0x42820277aad79992 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483019.281103:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483019.281315:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064038144 00000100:00100000:0.0:1788483019.281327:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064038144 00000100:00100000:0.0:1788483019.281510:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:0.0:1788483019.281523:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+57:11607:x1875360064038144:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788483019.281550:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483019.281572:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79999 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d1e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.281679:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.281693:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 58 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.281701:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.281732:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 58 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.281759:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 58 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483019.281772:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072416128:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788483019.281864:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788483019.285847:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483019.285978:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072416128:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788483019.286010:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.286096:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064038272 00000100:00100000:2.0:1788483019.286106:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064038272 00010000:00010000:2.0:1788483019.286147:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 59 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.286199:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:2.0:1788483019.286210:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+59:2352:x1875360064038272:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483019.286232:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483019.286241:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 59 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.286280:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 59 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.286302:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15a00/0x42820277aad79984 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d17 expref: 59 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.286322:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483019.286327:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.286528:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.286562:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.286595:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483019.286668:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+58:2352:x1875360064038272:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 458us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.286677:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00010000:00010000:0.0:1788483019.287478:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.287490:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483019.287555:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788483019.287561:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788483019.287586:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.287640:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79999 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 58 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.287662:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.287672:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788483019.287688:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483019.287691:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369200, rc 0) 00000100:00100000:0.0:1788483019.287752:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+57:11607:x1875360064038144:12345-192.168.201.6@tcp:101:bash.0 Request processed in 6231us (6666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483019.287762:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 209 00000100:00100000:1.0:1788483019.291846:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483019.291923:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064038528 00000100:00100000:2.0:1788483019.291934:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064038528 00000100:00100000:2.0:1788483019.291990:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1788483019.292002:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+57:11607:x1875360064038528:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:2.0:1788483019.292301:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+58:11607:x1875360064038528:12345-192.168.201.6@tcp:35:bash.0 Request processed in 301us (465us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788483019.292309:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:1.0:1788483019.400457:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483019.400558:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064038656 00000100:00100000:2.0:1788483019.400570:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064038656 00000100:00100000:2.0:1788483019.400652:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:2.0:1788483019.400663:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+58:11613:x1875360064038656:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483019.400690:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483019.400713:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad799a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d25 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.400790:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad799ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.400806:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad799ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.400844:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad799ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483019.400915:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1788483019.400919:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483019.400943:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad799ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.400968:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad799a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d25 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.400987:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad799ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d25 expref: 59 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.400996:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:2.0:1788483019.400999:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483019.401002:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66c00, rc 0) 00000100:00100000:2.0:1788483019.401069:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+59:11613:x1875360064038656:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 407us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.401076:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 210 00000100:00100000:0.0:1788483019.406609:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483019.406817:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064038784 00000100:00100000:3.0:1788483019.406843:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064038784 00000100:00100000:3.0:1788483019.406925:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:3.0:1788483019.406938:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+59:11613:x1875360064038784:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483019.406965:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483019.407013:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d2c expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407086:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407101:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407114:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407130:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407137:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407144:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407306:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407314:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407321:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483019.407368:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788483019.407374:0:6958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483019.407407:0:6958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407427:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407436:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407444:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407452:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407458:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483019.407465:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407474:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407489:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483019.407493:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483019.407498:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407504:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407522:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407530:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407542:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407548:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483019.407550:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407555:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407563:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb9231ebb00) 00010000:00010000:3.0:1788483019.407565:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483019.407568:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407574:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407608:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 61 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407640:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 60 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.407648:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788483019.407650:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788483019.407653:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15e00, rc 0) 00000100:00100000:3.0:1788483019.407749:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+60:11613:x1875360064038784:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 813us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.407768:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 211 00000100:00100000:1.0:1788483019.415678:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483019.415887:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064039040 00000100:00100000:2.0:1788483019.415900:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064039040 00000100:00100000:2.0:1788483019.415962:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:2.0:1788483019.415973:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+60:11613:x1875360064039040:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483019.415994:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483019.416016:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad799d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d33 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.416149:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.416175:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 61 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.416185:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 61 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.416194:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.416232:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 61 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.416287:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 61 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.416304:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d18000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072416256:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483019.416457:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 61 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.416467:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 61 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.416478:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072416384:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483019.416517:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788483019.417880:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483019.418463:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064039168 00000100:00100000:2.0:1788483019.418480:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064039168 00010000:00010000:2.0:1788483019.418545:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 62 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.418601:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:2.0:1788483019.418730:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9243b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+62:2353:x1875360064039168:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483019.418748:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483019.418755:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 62 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.418770:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 62 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.418796:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483019.418801:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.418811:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.418817:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483019.418931:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9243b0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+62:2353:x1875360064039168:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 320us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.418939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:1.0:1788483019.422113:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483019.422285:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064039296 00000100:00100000:3.0:1788483019.422297:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064039296 00010000:00010000:3.0:1788483019.422355:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 62 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483019.422407:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:3.0:1788483019.422416:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+62:2351:x1875360064039296:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483019.422431:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483019.422438:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 62 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.422454:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 62 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.422478:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788483019.422484:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.422495:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.422503:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.422525:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483019.422570:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+62:2351:x1875360064039296:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 155us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.422599:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00010000:00010000:2.0:1788483019.422889:0:5809:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.6@tcp) returned -22 from blocking AST (req@000000003051abb6 x1875360072416256) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 61 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.422917:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15e00/0x42820277aad799ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d2c expref: 61 pid: 6958 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.422938:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d18000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072416256:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483019.422952:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369200/0x42820277aad799a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d1e expref: 60 pid: 5807 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483019.422962:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1875360072416384:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483019.422981:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483019.422987:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.422997:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.423004:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483019.423025:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788483019.423788:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67a00/0x42820277aad799d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 61 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.423815:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.423826:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483019.423841:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483019.423845:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67000, rc 0) 00000100:00100000:2.0:1788483019.423911:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+60:11613:x1875360064039040:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 7940us (8246us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788483019.423920:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 212 00000100:00100000:1.0:1788483019.428550:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483019.428796:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064039552 00000100:00100000:2.0:1788483019.428812:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064039552 00000100:00100000:2.0:1788483019.428936:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:2.0:1788483019.428948:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+60:11613:x1875360064039552:12345-192.168.201.6@tcp:103:lfs.0 00010000:00010000:2.0:1788483019.428963:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483019.428988:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368400/0x42820277aad79937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d09 expref: 60 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483019.429008:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483019.429014:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483019.429070:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+59:11613:x1875360064039552:12345-192.168.201.6@tcp:103:lfs.0 Request processed in 123us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483019.429078:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788483019.431472:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483019.431564:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064039680 00000100:00100000:3.0:1788483019.431574:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064039680 00000100:00100000:3.0:1788483019.431655:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:3.0:1788483019.431667:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+59:11613:x1875360064039680:12345-192.168.201.6@tcp:58:lfs.0 00010000:00010000:3.0:1788483019.431788:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.431806:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483019.431818:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483019.432017:0:6958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788483019.432113:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+59:11613:x1875360064039680:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 448us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483019.432121:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 213 00000100:00100000:1.0:1788483019.436700:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483019.436859:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064039808 00000100:00100000:0.0:1788483019.436872:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064039808 00000100:00100000:0.0:1788483019.436950:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 214 00000100:00100000:0.0:1788483019.436963:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+59:11613:x1875360064039808:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788483019.436993:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483019.437023:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d3a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.437100:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.437114:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d3a expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.437139:0:5806:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.437167:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d3a expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.437184:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788483019.437187:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483019.437207:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d3a expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483019.437215:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368000, rc 0) 00000100:00100000:0.0:1788483019.437301:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+60:11613:x1875360064039808:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 342us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483019.437309:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 214 00010000:00010000:3.0:1788483019.635526:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788483020.210656:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788483020.210665:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483020.210698:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788483020.210704:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788483020.210908:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9056df480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072416512:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788483020.211017:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9183fe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483020.231773:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.231859:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064039936 00000100:00100000:3.0:1788483020.231870:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064039936 00000100:00100000:3.0:1788483020.232023:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00100000:3.0:1788483020.232036:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+61:11614:x1875360064039936:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788483020.232216:0:6958:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788483020.232442:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+61:11614:x1875360064039936:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 408us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483020.232450:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 215 00000100:00080000:1.0:1788483020.232567:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483020.233986:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9056df480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072416512:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788483020.254534:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.254788:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064040064 00000100:00100000:3.0:1788483020.254803:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064040064 00000100:00100000:3.0:1788483020.254900:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:3.0:1788483020.254914:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+60:11614:x1875360064040064:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788483020.255025:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255047:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255063:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255093:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255101:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255108:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255135:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255144:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255151:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483020.255206:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788483020.255232:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483020.255499:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255513:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255520:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255527:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255534:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483020.255538:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255546:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255940:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:3.0:1788483020.255945:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483020.255950:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255957:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad799f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255972:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255978:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.255998:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256004:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483020.256007:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256015:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256023:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9eb9231ebb00) 00010000:00010000:3.0:1788483020.256026:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483020.256029:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256035:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad799fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256053:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256060:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256065:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256698:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483020.256702:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256724:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256735:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788483020.256738:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483020.256741:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.256747:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15400/0x42820277aad79a02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483020.257577:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+60:11614:x1875360064040064:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 2658us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483020.257590:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 216 00000100:00100000:1.0:1788483020.262908:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.263142:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064040320 00000100:00100000:3.0:1788483020.263156:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064040320 00000100:00100000:3.0:1788483020.263230:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:3.0:1788483020.263241:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+60:11614:x1875360064040320:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483020.263295:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483020.263319:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14e00/0x42820277aad79a09 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d41 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263460:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263482:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263495:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483020.263510:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788483020.263784:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263807:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263813:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263819:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483020.263824:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263832:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263847:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:3.0:1788483020.263850:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788483020.263855:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263860:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14a00/0x42820277aad79a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263909:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14e00/0x42820277aad79a09 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d41 expref: 62 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.263921:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:3.0:1788483020.263923:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483020.264299:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14e00/0x42820277aad79a09 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d41 expref: 62 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.264312:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14e00, rc 0) 00000100:00100000:3.0:1788483020.264728:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+61:11614:x1875360064040320:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1486us (1830us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1788483020.264738:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 217 00000100:00100000:2.0:1788483020.293021:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483020.293315:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064040448 00000100:00100000:1.0:1788483020.293327:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064040448 00000100:00100000:2.0:1788483020.293830:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:2.0:1788483020.293845:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+61:11614:x1875360064040448:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788483020.293883:0:5809:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788483020.294129:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+61:11614:x1875360064040448:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 286us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.294138:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 218 00000100:00100000:1.0:1788483020.312679:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.312793:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064040704 00000100:00100000:3.0:1788483020.312811:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064040704 00000100:00100000:3.0:1788483020.312958:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:3.0:1788483020.312974:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+61:11614:x1875360064040704:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483020.313080:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483020.313086:0:6958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788483020.313134:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66c00/0x42820277aad799ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d25 expref: 61 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.313167:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:3.0:1788483020.313176:0:6958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483020.313198:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14e00/0x42820277aad79a1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d48 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788483020.314153:0:6958:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788483020.314463:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.314481:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.314494:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.314578:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14e00/0x42820277aad79a1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d48 expref: 63 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.314611:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d48 expref: 62 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.314621:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb911fa9900) 00010000:00010000:2.0:1788483020.314624:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483020.314627:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66800, rc 0) 00000100:00100000:2.0:1788483020.314728:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+62:11614:x1875360064040704:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1757us (2059us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788483020.314737:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 219 00000100:00100000:1.0:1788483020.345405:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.345533:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064040960 00000100:00100000:2.0:1788483020.345553:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064040960 00000100:00100000:2.0:1788483020.345692:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 220 00000100:00100000:2.0:1788483020.345705:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+62:11614:x1875360064040960:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788483020.345777:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483020.345812:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79a25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d48 expref: 62 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.345868:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb911fa9900) 00010000:00010000:2.0:1788483020.345881:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483020.345909:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.345926:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.345937:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.345952:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.345967:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.345974:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346230:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346240:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346345:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346352:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483020.346357:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346373:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346391:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:2.0:1788483020.346394:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483020.346399:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346405:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66400/0x42820277aad79a33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346417:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346423:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346430:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346435:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483020.346437:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346443:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346449:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x56334dbd (ffff9eb911fa9e00) 00010000:00010000:2.0:1788483020.346451:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483020.346454:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.346468:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x56334dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.346584:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+61:11614:x1875360064040960:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 878us (1204us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788483020.346592:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 220 00000100:00100000:0.0:1788483020.352787:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483020.353118:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064041088 00000100:00100000:1.0:1788483020.353132:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064041088 00000100:00100000:1.0:1788483020.353213:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:1.0:1788483020.353226:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+61:11614:x1875360064041088:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483020.353280:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483020.353312:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79a41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d4f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.353359:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.353388:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.353402:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.353738:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627000/0x42820277aad79a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 63 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.353762:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 62 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.353773:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:1.0:1788483020.353776:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788483020.353780:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626600, rc 0) 00000100:00100000:1.0:1788483020.353974:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+62:11614:x1875360064041088:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 749us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483020.353982:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 221 00000100:00100000:3.0:1788483020.374903:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483020.375029:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064041344 00000100:00100000:0.0:1788483020.375048:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064041344 00000100:00100000:0.0:1788483020.375149:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 222 00000100:00100000:0.0:1788483020.375162:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+62:11614:x1875360064041344:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788483020.375319:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.375339:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.375353:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483020.375699:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788483020.375711:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337541460411ns, next at 338541457450ns, rc = 0 00000004:00010000:0.0:1788483020.375817:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046e15d3b reply state 0000000032052b18 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483020.375828:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788483020.375952:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+64:11614:x1875360064041344:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 792us (1058us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788483020.375962:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 222 00010000:00010000:1.0:1788483020.386769:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483020.386774:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:1.0:1788483020.386793:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.386810:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.386817:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483020.386823:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.386832:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.386863:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:1.0:1788483020.386886:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788483020.386893:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.386899:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79a4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.387104:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064041472 00000100:00100000:2.0:1788483020.387117:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064041472 00000100:00100000:2.0:1788483020.387194:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 223 00000100:00100000:2.0:1788483020.387206:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+63:11614:x1875360064041472:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483020.387234:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483020.387296:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d56 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.387365:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 64 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.387389:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 64 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.387410:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:2.0:1788483020.387414:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483020.387417:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67800, rc 0) 00000100:00100000:2.0:1788483020.387496:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+64:11614:x1875360064041472:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 290us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.387504:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 223 00000100:00100000:1.0:1788483020.399083:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483020.399223:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064041600 00000100:00100000:0.0:1788483020.399239:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064041600 00000100:00100000:0.0:1788483020.399418:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:0.0:1788483020.399435:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360064041600:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788483020.399925:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+10:2352:x1875360064041600:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 493us (857us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788483020.399935:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00080000:1.0:1788483020.400032:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483020.407416:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.410852:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064041856 00000100:00100000:2.0:1788483020.410878:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064041856 00000100:00100000:2.0:1788483020.411066:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1788483020.411082:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+64:11614:x1875360064041856:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788483020.411496:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+65:11614:x1875360064041856:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 405us (4084us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788483020.411505:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1788483020.414099:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483020.414366:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064042112 00000100:00100000:0.0:1788483020.414388:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064042112 00000100:00100000:0.0:1788483020.414486:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 224 00000100:00100000:0.0:1788483020.414499:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+65:11614:x1875360064042112:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788483020.414707:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+65:11614:x1875360064042112:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 210us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483020.414716:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 224 00000100:00100000:0.0:1788483020.418402:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.418515:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064042240 00000100:00100000:2.0:1788483020.418529:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064042240 00000100:00100000:2.0:1788483020.418622:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:2.0:1788483020.418638:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+65:11614:x1875360064042240:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483020.418668:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483020.418696:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79a5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.418808:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.418829:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.418844:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483020.418896:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483020.418919:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.418976:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79a5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d5d expref: 67 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.419001:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d5d expref: 66 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.419012:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:2.0:1788483020.419015:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788483020.419020:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66a00, rc 0) 00000100:00100000:2.0:1788483020.419430:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+66:11614:x1875360064042240:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 795us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.419439:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 225 00000100:00100000:3.0:1788483020.423825:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.423963:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064042368 00000100:00100000:2.0:1788483020.423975:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064042368 00000100:00100000:2.0:1788483020.424056:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:2.0:1788483020.424068:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+10:2352:x1875360064042368:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483020.424091:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483020.424115:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d64 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483020.424151:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a15cc, blocks: 0x1 00010000:00010000:2.0:1788483020.424176:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1788483020.424182:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483020.424193:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.424237:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.424288:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67e00, rc 0) 00000100:00100000:2.0:1788483020.424355:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+11:2352:x1875360064042368:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 290us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.424363:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:3.0:1788483020.427471:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.427596:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064042624 00000100:00100000:2.0:1788483020.427618:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064042624 00000100:00100000:2.0:1788483020.427699:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 226 00000100:00100000:2.0:1788483020.427712:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+66:11614:x1875360064042624:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788483020.428063:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+66:11614:x1875360064042624:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 352us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.428072:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 226 00000100:00100000:0.0:1788483020.431557:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.431708:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064042752 00000100:00100000:3.0:1788483020.431725:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064042752 00000100:00100000:3.0:1788483020.431811:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:3.0:1788483020.431825:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+11:11614:x1875360064042752:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483020.431854:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483020.431891:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d6b expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.431940:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 12 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.431951:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483020.431957:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483020.431963:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 12 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.432013:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 12 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.432033:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 12 pid: 6660 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483020.432062:0:6662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93fe19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6662:1875360072416640:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483020.432212:0:6662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90313e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483020.436713:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.436948:0:6662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93fe19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6662:1875360072416640:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483020.436999:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 12 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.437030:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14a00, rc 0) 00000100:00100000:3.0:1788483020.437120:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+12:11614:x1875360064042752:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 5297us (5579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483020.437155:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:2.0:1788483020.438204:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064042880 00000100:00100000:2.0:1788483020.438220:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064042880 00010000:00010000:2.0:1788483020.442572:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 12 pid: 6660 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.442676:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:2.0:1788483020.442706:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+12:2351:x1875360064042880:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483020.442731:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483020.442764:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 12 pid: 6660 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.442807:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 12 pid: 6660 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.442839:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee5dda74/0x42820277aad79a6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d64 expref: 12 pid: 6660 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.442860:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483020.442864:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483020.442874:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.442884:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.442935:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.442955:0:5793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5793:1875360072416768:192.168.201.6@tcp:105: 00000100:00100000:2.0:1788483020.443438:0:5793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788483020.451639:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483020.451810:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064043008 00000100:00100000:1.0:1788483020.451823:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064043008 00002000:00100000:1.0:1788483020.451889:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9eb9056dfb80 x1875360064043008/t0(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:526/0 lens 504/0 e 0 to 0 dl 1788483031 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483020.451901:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb9056dfb80 with x1875360064043008 ext(0->12) 00002000:00010000:1.0:1788483020.451909:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb9056dfb80 00000100:00100000:1.0:1788483020.451947:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788483020.451959:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa30c745-265d-4a44-8753-67e411452897+12:2351:x1875360064043008:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788483020.452745:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa30c745-265d-4a44-8753-67e411452897+14:2351:x1875360064043008:12345-192.168.201.6@tcp:4:lhsmtool_posix.0 Request processed in 782us (1115us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788483020.452756:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00002000:00100000:1.0:1788483020.452765:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9eb9056dfb80 x1875360064043008/t4294967320(0) o4->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:526/0 lens 504/448 e 0 to 0 dl 1788483031 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483020.452774:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb9056dfb80 with x1875360064043008 ext(0->12) 00002000:00010000:1.0:1788483020.452778:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb9056dfb80 00000100:00100000:0.0:1788483020.455615:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483020.455937:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064043136 00000100:00100000:1.0:1788483020.455953:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064043136 00000100:00100000:1.0:1788483020.456031:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:1.0:1788483020.456169:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+66:11614:x1875360064043136:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788483020.456576:0:5793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5793:1875360072416768:192.168.201.6@tcp:105: 00010000:00010000:2.0:1788483020.456620:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483020.456734:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+13:2351:x1875360064042880:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 14047us (20036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.456745:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000001:00080000:0.0:1788483020.495174:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788483020.495191:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:0.0:1788483020.495241:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788483020.495309:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eb90384cc00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788483020.495324:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb9063ed700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eb90384cd80 00000020:00080000:0.0:1788483020.495327:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb9063edb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eb9071eb400 00000004:00080000:0.0:1788483020.495342:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1788483020.495356:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:0.0:1788483020.495470:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eb9071ad480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788483020.495474:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb93f7a7e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eb9071ad540 00000020:00080000:0.0:1788483020.495477:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb93f7a7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eb93afc0400 00000020:00080000:0.0:1788483020.495495:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788483020.496000:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788483020.496239:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483020.496290:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072416896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788483020.496752:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483020.496875:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072416896 00000100:00100000:0.0:1788483020.496887:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072416896 00000100:00100000:0.0:1788483020.496960:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788483020.496974:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072416896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788483020.497018:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788483020.497085:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9a15ca, atime: 0x6a9a15cb, ctime: 0x6a9a15ca, blocks: 0x1 00010000:00010000:0.0:1788483020.497096:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.497125:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1788483020.497153:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483020.497162:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.497184:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.497197:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.497206:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.497233:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788483020.499226:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072417152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788483020.499428:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483020.499493:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483020.499505:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072417024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788483020.499738:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483020.499915:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072417152 00000100:00100000:1.0:1788483020.499927:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072417152 00000100:00100000:1.0:1788483020.499988:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072417024 00000100:00100000:1.0:1788483020.499991:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072417024 00000100:00100000:1.0:1788483020.500010:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788483020.500021:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072417152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788483020.500405:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788483020.500418:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:1.0:1788483020.500883:0:12045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788483020.500888:0:12045:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788483020 00002000:00010000:1.0:1788483020.500891:0:12045:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788483020.500893:0:12045:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788483020 -> 1788483020 00002000:00010000:1.0:1788483020.500895:0:12045:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788483020.500975:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3279:x1875360072417152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 953us (1545us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788483020.500984:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788483020.501013:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788483020.501024:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072417024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788483020.501044:0:12045:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00000004:00080000:2.0:1788483020.501449:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb936d1aa00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788483020.501457:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072417152:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788483020.501694:0:12045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.501721:0:12045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 12 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.501750:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788483020.501756:0:12045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788483020.501761:0:12045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483020.502063:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3278:x1875360072416896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5091us (5311us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788483020.502074:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1788483020.502155:0:12045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 12 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.502174:0:12045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 12 pid: 6663 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483020.502192:0:12045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12045:1875360072417280:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788483020.502325:0:12045:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180a4c00 going to sleep for 11 seconds 00000100:00080000:1.0:1788483020.502340:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788483020.502906:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483020.502919:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.502931:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483020.502938:0:8489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.502952:0:8489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.502975:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.502982:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbea036a/0x42820277aad79a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.503005:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483020.503008:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483020.503009:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483020.503221:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+20:11614:x1875360064043136:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 47168us (47635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483020.503232:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 227 00000100:00100000:0.0:1788483020.508645:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483020.508684:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483020.508719:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064043264 00000100:00100000:0.0:1788483020.508730:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064043264 00000100:00100000:0.0:1788483020.508799:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:0.0:1788483020.508813:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+13:2352:x1875360064043264:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788483020.509662:0:12045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12045:1875360072417280:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788483020.509696:0:12045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483020.509951:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064043392 00000100:00100000:3.0:1788483020.509960:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064043392 00010000:00010000:3.0:1788483020.510015:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 14 pid: 6663 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483020.510062:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:3.0:1788483020.510073:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+14:2352:x1875360064043392:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483020.510090:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483020.510098:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 14 pid: 6663 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.510113:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 14 pid: 6663 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.510144:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce97aa5c/0x42820277aad7983b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cca expref: 14 pid: 6663 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.510166:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483020.510171:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483020.510179:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.510191:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.510227:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483020.510331:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+13:2352:x1875360064043392:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 259us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483020.510346:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00010000:00010000:1.0:1788483020.511718:0:12045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.511736:0:12045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.511765:0:12045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.511774:0:12045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.511866:0:12045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788483020.513909:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb93718c700/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788483020.513941:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072416896:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788483020.521842:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483020.521862:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.521896:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483020.521902:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.521915:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.522222:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.522317:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79a80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.522346:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483020.522348:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483020.522350:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483020.524762:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3277:x1875360072417024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23728us (25010us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788483020.524793:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1788483020.527217:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb936d1a680/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788483020.527239:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072417024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788483020.552188:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa30c745-265d-4a44-8753-67e411452897+12:2352:x1875360064043264:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 43353us (43476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483020.552213:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000001:00080000:2.0:1788483020.552369:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1788483020.552400:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1788483020.552407:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788483020.564786:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483020.565153:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064043648 00000100:00100000:1.0:1788483020.565169:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064043648 00000100:00100000:1.0:1788483020.565285:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 228 00000100:00100000:1.0:1788483020.565299:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+20:11614:x1875360064043648:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788483020.565393:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483020.565430:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d5d expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.565455:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:1.0:1788483020.565462:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788483020.565508:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.565528:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.565564:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788483020.570323:0:5806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bfac6f1 reply state 0000000066812cd0 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483020.570487:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788483020.570709:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+21:11614:x1875360064043648:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 5405us (6486us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788483020.570722:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 228 00000100:00100000:0.0:1788483020.575606:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:1.0:1788483020.575722:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.575739:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.575747:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.575753:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483020.575759:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.575767:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.575789:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:1.0:1788483020.575792:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483020.575798:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.575830:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627200/0x42820277aad79a87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.576042:0:12501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064043776 00000100:00100000:2.0:1788483020.576055:0:12501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064043776 00000100:00100000:2.0:1788483020.576129:0:12501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:2.0:1788483020.576142:0:12501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064043776:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788483020.576509:0:12501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788483020.576514:0:12501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788483020 -> 1788483019 00002000:00010000:2.0:1788483020.576517:0:12501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788483019 00002000:00010000:2.0:1788483020.576520:0:12501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788483020 -> 1788483019 00002000:00010000:2.0:1788483020.576523:0:12501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788483020.576602:0:12501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064043776:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 462us (1016us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788483020.576621:0:12501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:3.0:1788483020.580174:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.583627:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064044032 00000100:00100000:2.0:1788483020.583652:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064044032 00000100:00100000:2.0:1788483020.583766:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:2.0:1788483020.583780:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93fe19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+20:11614:x1875360064044032:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788483020.583880:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.583901:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.583911:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.583968:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.583984:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 20 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.584000:0:5807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072417408:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483020.584139:0:5807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb923106f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483020.588349:0:5807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1875360072417408:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483020.588402:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483020.589457:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.589820:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064044160 00000100:00100000:3.0:1788483020.589835:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064044160 00010000:00010000:3.0:1788483020.589904:0:8490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 21 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483020.590509:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:3.0:1788483020.590530:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+21:2351:x1875360064044160:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483020.590555:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483020.590564:0:8490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 21 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.590582:0:8490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 21 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.590614:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f626600/0x42820277aad79a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d4f expref: 21 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.590643:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:3.0:1788483020.590650:0:8490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.590664:0:8490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.590683:0:8490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.590753:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483020.591563:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+20:2351:x1875360064044160:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 1034us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483020.591575:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00010000:00010000:0.0:1788483020.591929:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.591942:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.592010:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.592017:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.592025:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.592240:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483020.592246:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.592280:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.592297:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:0.0:1788483020.592300:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788483020.592306:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.592320:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67e00/0x42820277aad79a8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483020.592960:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93fe19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+19:11614:x1875360064044032:12345-192.168.201.6@tcp:55:lhsmtool_posix.0 Request processed in 9179us (12802us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788483020.592972:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 229 00000100:00100000:0.0:1788483020.604396:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483020.605298:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064044288 00000100:00100000:1.0:1788483020.605314:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064044288 00000100:00100000:1.0:1788483020.605402:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:1.0:1788483020.605415:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+8:2351:x1875360064044288:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788483020.605483:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.605517:0:6663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.605526:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483020.605531:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788483020.605535:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.605576:0:6663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.605590:0:6663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 8 pid: 6662 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483020.605609:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1875360072417536:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788483020.605764:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483020.609094:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.609230:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064044416 00000100:00100000:3.0:1788483020.609246:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064044416 00010000:00010000:3.0:1788483020.609370:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 9 pid: 6662 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483020.609421:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:3.0:1788483020.609433:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360064044416:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483020.609456:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483020.609495:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 9 pid: 6662 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.609517:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 9 pid: 6662 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.609560:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483020.609566:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483020.609574:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.609587:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.609648:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483020.609732:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937065500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa30c745-265d-4a44-8753-67e411452897+9:2352:x1875360064044416:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 299us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483020.609741:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00010000:00010000:1.0:1788483020.610552:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031165f2d/0x42820277aad79a72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d6b expref: 8 pid: 6662 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483020.610577:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6663:1875360072417536:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788483020.610610:0:6663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610624:0:6663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610631:0:6663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610673:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610681:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610691:0:6663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610701:0:6663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483020.610706:0:6663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610735:0:6663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610753:0:6663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.610761:0:6663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79a95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483020.610862:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064044288:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 5450us (6490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483020.610873:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 70 00000100:00100000:0.0:1788483020.614636:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.614802:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064044672 00000100:00100000:2.0:1788483020.614828:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064044672 00000100:00100000:2.0:1788483020.614924:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 230 00000100:00100000:2.0:1788483020.614939:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+19:11614:x1875360064044672:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788483020.622179:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.622225:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.622571:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.623470:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.623498:0:6958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.623802:0:6958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.623876:0:6958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.623897:0:6958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 20 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483020.623917:0:6958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072417664:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788483020.624205:0:6958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483020.629473:0:6958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072417664:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788483020.629736:0:6958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.629874:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483020.630466:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064044800 00000100:00100000:3.0:1788483020.630480:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064044800 00010000:00010000:3.0:1788483020.630743:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 21 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483020.630798:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:3.0:1788483020.630813:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9243b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+21:2352:x1875360064044800:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483020.630835:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483020.630846:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 21 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.630864:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 21 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.630894:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79a56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d56 expref: 21 pid: 5807 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.630918:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:3.0:1788483020.630937:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.630948:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.630969:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483020.631004:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483020.631226:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9243b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa30c745-265d-4a44-8753-67e411452897+20:2352:x1875360064044800:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 415us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483020.631235:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00010000:00010000:0.0:1788483020.631541:0:6958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.631550:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788483020.631835:0:6958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788483020.632040:0:6958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788483020.632091:0:6958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788483020.632213:0:6958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6958:1875360072417792:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788483020.632326:0:6958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483020.632370:0:6958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483020.632698:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072417792 00000100:00100000:2.0:1788483020.632708:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072417792 00000100:00100000:2.0:1788483020.632766:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483020.632778:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6958:x1875360072417792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788483020.632875:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6958:x1875360072417792:12345-0@lo:1000:mdt00_003.0 Request processed in 99us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.632883:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788483020.633833:0:6958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788483020.633843:0:6958:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788483020.633871:0:6958:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb936d1aa00, transno 4294967321 00000100:00100000:0.0:1788483020.633945:0:6958:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9eb936d1a680 x1875360072417024/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788483036 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483020.633960:0:6958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6958:1875360072417792:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788483020.634574:0:6958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1788483020.634692:0:6958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6958:1875360072417920:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788483020.634755:0:6958:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483020.634796:0:6958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483020.635446:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072417920 00000100:00100000:3.0:1788483020.635457:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072417920 00000100:00100000:3.0:1788483020.635534:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788483020.635547:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6958:x1875360072417920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788483020.635873:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6958:x1875360072417920:12345-0@lo:1000:mdt00_003.0 Request processed in 328us (1116us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788483020.635882:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788483020.636148:0:6958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6958:1875360072417920:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788483020.636205:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636217:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636242:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636282:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483020.636289:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636299:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636443:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb9050b3300) 00010000:00010000:0.0:1788483020.636448:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483020.636454:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636460:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79aa3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636503:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636562:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636569:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636575:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483020.636578:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636744:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636755:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788483020.636758:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483020.636767:0:6958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d3a expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636779:0:6958:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d3a expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636788:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d3a expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.636827:0:6958:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d3a expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483020.636843:0:6958:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937064380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072418048:192.168.201.6@tcp:105: 00000100:00100000:0.0:1788483020.636999:0:6958:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483020.643645:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483020.643789:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064044928 00000100:00100000:1.0:1788483020.643803:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064044928 00000100:00100000:1.0:1788483020.643880:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:1.0:1788483020.643893:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+24:11613:x1875360064044928:12345-192.168.201.6@tcp:49:lfs.0 00000100:00100000:1.0:1788483020.644061:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+24:11613:x1875360064044928:12345-192.168.201.6@tcp:49:lfs.0 Request processed in 170us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483020.644070:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:2.0:1788483020.644833:0:6958:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937064380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6958:1875360072418048:192.168.201.6@tcp:105: 00010000:00010000:2.0:1788483020.644865:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644874:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15600/0x42820277aad799e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644908:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644929:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644940:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644949:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644971:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644976:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644980:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483020.644983:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644988:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.644998:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483020.645000:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483020.645003:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.645007:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad79aaa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.645014:0:6958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.645018:0:6958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.645021:0:6958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.645024:0:6958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483020.645031:0:6958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.645038:0:6958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.645046:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483020.645049:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483020.645052:0:6958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.645058:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79a9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.645348:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+23:11614:x1875360064044672:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 30412us (30729us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1788483020.645357:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 230 00000020:00080000:2.0:1788483020.645361:0:6958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788483020.645786:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483020.645790:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483020.646180:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788483020.646189:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483020.653763:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483020.653887:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.654050:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064045440 00000100:00100000:2.0:1788483020.654064:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064045440 00000100:00100000:2.0:1788483020.654145:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:2.0:1788483020.654168:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918844c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+23:11614:x1875360064045440:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788483020.656584:0:5810:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788483020.656879:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1788483020.657054:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064045184 00000100:00100000:3.0:1788483020.657068:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064045184 00010000:00010000:2.0:1788483020.657244:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.657285:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.657300:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.657334:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.657342:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.657349:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.657396:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483020.657697:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483020.657706:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.657715:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483020.657721:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.657730:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.657746:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9eb911fa9a00) 00010000:00010000:1.0:1788483020.657749:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788483020.657755:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.657761:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad79ab1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.657785:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483020.657788:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483020.657790:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483020.658115:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918844c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+26:11614:x1875360064045440:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 3951us (4218us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788483020.658128:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000020:00080000:2.0:1788483020.658135:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788483020.660870:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 231 00000100:00100000:2.0:1788483020.660908:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+25:11613:x1875360064045184:12345-192.168.201.6@tcp:58:lfs.0 00000040:00080000:2.0:1788483020.662106:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788483020.662842:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+25:11613:x1875360064045184:12345-192.168.201.6@tcp:58:lfs.0 Request processed in 1943us (9085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.662860:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 231 00010000:00010000:1.0:1788483020.664212:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483020.707271:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483020.707660:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064045568 00000100:00100000:0.0:1788483020.707676:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064045568 00000100:00100000:0.0:1788483020.707761:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 232 00000100:00100000:0.0:1788483020.707775:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+25:11616:x1875360064045568:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788483020.707810:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483020.707840:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d72 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.707968:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.707986:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708000:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708017:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708024:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708031:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708768:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708782:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708791:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708837:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483020.708864:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 26 pid: 5809 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483020.708881:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937064700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072418176:192.168.201.6@tcp:104: 00000100:00100000:0.0:1788483020.709697:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483020.713981:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937064700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1875360072418176:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788483020.714022:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483020.716398:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483020.716690:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064045824 00000100:00100000:0.0:1788483020.716706:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064045824 00000100:00100000:0.0:1788483020.716785:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:0.0:1788483020.716801:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+27:5593:x1875360064045824:12345-192.168.201.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788483020.717858:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+28:5593:x1875360064045824:12345-192.168.201.6@tcp:35:ldlm_bl.0 Request processed in 1053us (1467us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788483020.717872:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 63 00000100:00100000:0.0:1788483020.721409:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483020.721642:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064045952 00000100:00100000:2.0:1788483020.721655:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064045952 00010000:00010000:2.0:1788483020.721712:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 28 pid: 5809 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483020.721765:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:2.0:1788483020.721779:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+28:2351:x1875360064045952:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483020.721822:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483020.721831:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 28 pid: 5809 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.721847:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 28 pid: 5809 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.721877:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67000/0x42820277aad799d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d33 expref: 28 pid: 5809 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.721899:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483020.721906:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.721917:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.721940:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483020.721982:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483020.722054:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa30c745-265d-4a44-8753-67e411452897+27:2351:x1875360064045952:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 277us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483020.722062:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00010000:00010000:1.0:1788483020.723050:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723066:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483020.723145:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788483020.723177:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788483020.723209:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723228:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723243:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723278:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723287:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723294:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483020.723299:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723318:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723333:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:1.0:1788483020.723337:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483020.723342:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723349:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369400/0x42820277aad79abf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723365:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723392:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723398:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723403:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483020.723406:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723413:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723421:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9eb907174500) 00010000:00010000:1.0:1788483020.723423:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483020.723426:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723432:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369e00/0x42820277aad79ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723480:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad79ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d72 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723495:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d72 expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483020.723503:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788483020.723505:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483020.723739:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368e00, rc 0) 00000100:00100000:1.0:1788483020.723823:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+26:11616:x1875360064045568:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 16049us (16584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483020.723832:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 232 00000040:00080000:1.0:1788483021.693134:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483021.693143:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788483021.693191:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788483021.693198:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483021.693397:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072418304:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788483021.693506:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd180 going to sleep for 11 seconds 00010000:00010000:1.0:1788483021.693525:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483021.715848:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1875360072418304:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788483021.716803:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483021.716835:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064046080 00000100:00100000:1.0:1788483021.716844:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064046080 00000100:00100000:1.0:1788483021.716898:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 233 00000100:00100000:1.0:1788483021.716909:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+26:11628:x1875360064046080:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788483021.716949:0:5807:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788483021.717056:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+26:11628:x1875360064046080:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 148us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483021.717064:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 233 00000100:00100000:1.0:1788483021.741498:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483021.741614:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064046336 00000100:00100000:2.0:1788483021.741624:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064046336 00000100:00100000:2.0:1788483021.741696:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 234 00000100:00100000:2.0:1788483021.741708:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+26:11628:x1875360064046336:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483021.741744:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483021.741768:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79ad4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d79 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483021.741903:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483021.741921:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483021.741935:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483021.741951:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788483021.742114:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79ad4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d79 expref: 29 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483021.742136:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d79 expref: 28 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483021.742148:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483021.742151:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483021.742155:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66800, rc 0) 00000100:00100000:2.0:1788483021.742239:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+28:11628:x1875360064046336:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 533us (759us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788483021.742277:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 234 00000100:00100000:0.0:1788483021.753699:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072418816:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.753772:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483021.753836:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788483021.753842:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072418432:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.753873:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483021.753897:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072418944:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.753924:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483021.753971:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072418560:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.753998:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483021.754014:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072419072:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754035:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483021.754057:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483021.754062:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072418688:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754081:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483021.754114:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072418816 00000100:00100000:0.0:1788483021.754122:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072418816 00000100:00100000:0.0:1788483021.754177:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072419072 00000100:00100000:0.0:1788483021.754180:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072419072 00000100:00100000:0.0:1788483021.754217:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788483021.754229:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072418816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754322:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072418816:12345-0@lo:400:kworker.0 Request processed in 94us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.754330:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788483021.754346:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788483021.754362:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072419072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754394:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3277:x1875360072419072:12345-0@lo:400:kworker.0 Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.754400:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788483021.754417:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072418432 00000100:00100000:0.0:1788483021.754421:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072418432 00000100:00100000:0.0:1788483021.754444:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788483021.754450:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072418432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754479:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072418432:12345-0@lo:400:kworker.0 Request processed in 29us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.754496:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788483021.754523:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072418944 00000100:00100000:0.0:1788483021.754527:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072418944 00000100:00100000:0.0:1788483021.754550:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072418560 00000100:00100000:0.0:1788483021.754553:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072418560 00000100:00100000:0.0:1788483021.754562:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072418688 00000100:00100000:0.0:1788483021.754564:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072418688 00000100:00100000:0.0:1788483021.754578:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788483021.754583:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072418944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754614:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875360072418944:12345-0@lo:400:kworker.0 Request processed in 31us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.754620:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788483021.754631:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788483021.754637:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072418560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754660:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072418560:12345-0@lo:400:kworker.0 Request processed in 24us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.754666:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788483021.754676:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788483021.754682:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072418688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754703:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072418688:12345-0@lo:400:kworker.0 Request processed in 22us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483021.754708:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1788483021.754729:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483021.754733:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788483021.754759:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072418432:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754773:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072418944:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754791:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072418816:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754820:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072418688:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754829:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072418560:0@lo:400:kworker.0 00000100:00100000:0.0:1788483021.754838:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937064e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072419072:0@lo:400:kworker.0 00000100:00100000:1.0:1788483021.758770:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483021.758817:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483021.758850:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064046720 00000100:00100000:1.0:1788483021.758859:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064046720 00000100:00100000:1.0:1788483021.758915:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 235 00000100:00100000:1.0:1788483021.758942:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+28:11628:x1875360064046720:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788483021.759043:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759062:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759075:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759309:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759318:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759325:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759331:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483021.759335:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759343:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759889:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788483021.759895:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788483021.759902:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483021.759909:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627e00/0x42820277aad79ae9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483021.760122:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+29:11628:x1875360064046720:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 1181us (1301us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788483021.760133:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 235 00000040:00080000:1.0:1788483021.760305:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788483021.760311:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788483021.761834:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064046464 00000100:00100000:2.0:1788483021.761849:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064046464 00000100:00100000:2.0:1788483021.761926:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788483021.761945:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+29:2351:x1875360064046464:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788483021.761962:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483021.761985:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d79 expref: 29 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483021.762006:0:8490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483021.762011:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788483021.762065:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa30c745-265d-4a44-8753-67e411452897+28:2351:x1875360064046464:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 124us (3307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483021.762073:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000040:00080000:1.0:1788483021.763515:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788483021.763532:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483021.771235:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483021.772409:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064046976 00000100:00100000:3.0:1788483021.772423:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064046976 00000100:00100000:3.0:1788483021.772494:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 64 00000100:00100000:3.0:1788483021.772506:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+28:11628:x1875360064046976:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788483021.772817:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+29:11628:x1875360064046976:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 313us (1591us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788483021.772825:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 64 00000001:00080000:0.0:1788483021.832953:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788483021.832977:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:2.0:1788483021.870068:0:12541:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483021.870079:0:12541:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483021.870124:0:12541:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788483021.870130:0:12541:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788483022.029503:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483022.034170:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064047232 00000100:00100000:2.0:1788483022.034193:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064047232 00000100:00100000:2.0:1788483022.034305:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:2.0:1788483022.034317:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+29:11641:x1875360064047232:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483022.034340:0:6958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483022.034369:0:6958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79af0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d80 expref: -99 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483022.034474:0:6958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79af7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483022.034489:0:6958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79af7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483022.034519:0:6958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79af7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483022.034532:0:6958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:3.0:1788483022.034724:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788483022.035220:0:6958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66800/0x42820277aad79af0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d80 expref: 32 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483022.035274:0:6958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79af7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d80 expref: 31 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483022.035284:0:6958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:2.0:1788483022.035287:0:6958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788483022.035290:0:6958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c66a00, rc 0) 00000100:00100000:2.0:1788483022.035388:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa30c745-265d-4a44-8753-67e411452897+31:11641:x1875360064047232:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1072us (5893us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788483022.035397:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 236 00000100:00100000:3.0:1788483022.045119:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483022.045535:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064047360 00000100:00100000:1.0:1788483022.045545:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064047360 00000100:00100000:1.0:1788483022.045769:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 237 00000100:00100000:1.0:1788483022.045781:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9056dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+31:11641:x1875360064047360:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:1.0:1788483022.045857:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045874:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045885:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045911:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045918:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045925:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045947:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483022.045952:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045960:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045972:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:1.0:1788483022.045975:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788483022.045978:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.045984:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f627400/0x42820277aad79b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483022.046059:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9056dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa30c745-265d-4a44-8753-67e411452897+31:11641:x1875360064047360:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 281us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483022.046066:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 237 00000100:00100000:0.0:1788483022.118151:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483022.121667:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064047488 00000100:00100000:1.0:1788483022.121687:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064047488 00000100:00100000:1.0:1788483022.121795:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00100000:1.0:1788483022.121812:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+7:2353:x1875360064047488:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:1.0:1788483022.121836:0:6663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483022.121861:0:6663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009287900b/0x42820277aad79b0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d87 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483022.121892:0:6663:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9a15cb, atime: 0x6a9a15cb, ctime: 0x6a9a15cb, blocks: 0xb 00010000:00010000:1.0:1788483022.121917:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1788483022.121937:0:6663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483022.121949:0:6663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009287900b/0x42820277aad79b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d87 expref: 8 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.121971:0:6663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009287900b/0x42820277aad79b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d87 expref: 8 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483022.121987:0:6663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627400, rc 0) 00000100:00100000:1.0:1788483022.122085:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+8:2353:x1875360064047488:12345-192.168.201.6@tcp:101:cat.0 Request processed in 279us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483022.122092:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 71 00000100:00080000:3.0:1788483022.122340:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483022.127323:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483022.127455:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064047616 00000100:00100000:1.0:1788483022.127472:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064047616 00002000:00100000:1.0:1788483022.127541:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9eb9217e4700 x1875360064047616/t0(0) o3->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:528/0 lens 488/0 e 0 to 0 dl 1788483033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483022.127552:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb9217e4700 with x1875360064047616 ext(0->4095) 00002000:00010000:1.0:1788483022.127559:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb9217e4700 00000100:00100000:1.0:1788483022.127618:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788483022.127634:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+8:2354:x1875360064047616:12345-192.168.201.6@tcp:3:cat.0 00000100:00100000:1.0:1788483022.129009:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa30c745-265d-4a44-8753-67e411452897+8:2354:x1875360064047616:12345-192.168.201.6@tcp:3:cat.0 Request processed in 1367us (1694us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788483022.129021:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00002000:00100000:1.0:1788483022.129038:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9eb9217e4700 x1875360064047616/t0(0) o3->aa30c745-265d-4a44-8753-67e411452897@192.168.201.6@tcp:528/0 lens 488/4536 e 0 to 0 dl 1788483033 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788483022.129051:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9eb9217e4700 with x1875360064047616 ext(0->4095) 00002000:00010000:1.0:1788483022.129070:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9eb9217e4700 00000100:00100000:1.0:1788483022.260237:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483022.260318:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072419200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483022.260454:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483022.260528:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072419200 00000100:00100000:0.0:1788483022.260541:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072419200 00000100:00100000:0.0:1788483022.260599:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788483022.260612:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072419200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483022.260648:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483022.260755:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072419200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483022.260763:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788483022.261092:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788483022.261099:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788483022.261123:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb93718c700, transno 4294967310 00000100:00100000:1.0:1788483022.261150:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072419200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788483022.708043:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483023.282754:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072419328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483023.282844:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483023.282994:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072419328 00000100:00100000:0.0:1788483023.283004:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072419328 00000100:00100000:0.0:1788483023.283085:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788483023.283098:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072419328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483023.283144:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483023.283198:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072419328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483023.283205:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788483023.283299:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072419328:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788483023.283390:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483023.325836:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483023.325999:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064047744 00000100:00100000:3.0:1788483023.326023:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064047744 00000100:00100000:3.0:1788483023.326080:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 301 00000100:00100000:3.0:1788483023.326089:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360064047744:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483023.334928:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360064047744:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 8822us (9088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483023.334948:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 301 00000100:00100000:0.0:1788483023.341494:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483023.341588:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483023.341732:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483023.341764:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483023.342757:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064048256 00000100:00100000:1.0:1788483023.342771:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064048256 00000100:00100000:1.0:1788483023.342834:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064047872 00000100:00100000:1.0:1788483023.342838:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064047872 00000100:00100000:1.0:1788483023.342864:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:1.0:1788483023.342874:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360064048256:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483023.342949:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:2352:x1875360064048256:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 75us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.342956:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:1.0:1788483023.342974:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:1.0:1788483023.342982:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+31:2352:x1875360064047872:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483023.343005:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+31:2352:x1875360064047872:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483023.343011:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00080000:1.0:1788483023.343038:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483023.352884:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064048000 00000100:00100000:3.0:1788483023.352901:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064048000 00000100:00100000:3.0:1788483023.353116:0:12501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064048128 00000100:00100000:3.0:1788483023.353121:0:12501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064048128 00000100:00100000:3.0:1788483023.356597:0:12501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:3.0:1788483023.356636:0:12501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064048000:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483023.356757:0:12501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa30c745-265d-4a44-8753-67e411452897+8:2352:x1875360064048000:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 133us (15272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483023.356766:0:12501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:3.0:1788483023.356798:0:12501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1788483023.356808:0:12501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360064048128:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483023.356834:0:12501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360064048128:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (15070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483023.356841:0:12501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00080000:3.0:1788483023.356865:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788483023.730835:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483024.758125:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483024.822608:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483024.822622:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483024.822665:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788483024.822673:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788483025.778756:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788483025.913737:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:3.0:1788483025.913762:0:5829:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9eb9086a0a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788483025.913770:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb939e00000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9eb9086a03c0 00000020:00080000:3.0:1788483025.913774:0:5829:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9eb939e00800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9eb93f123c00 00000020:00080000:3.0:1788483025.913840:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788483025.913852:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1788483025.913862:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788483025.913904:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788483025.915482:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1788483025.923534:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788483025.923554:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788483025.923562:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:1.0:1788483026.803081:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483026.832303:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483026.832341:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064048384 00000100:00100000:3.0:1788483026.832436:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064048384 00000100:00100000:3.0:1788483026.832503:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 238 00000100:00100000:3.0:1788483026.832514:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+18:11293:x1875360064048384:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788483026.832607:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa30c745-265d-4a44-8753-67e411452897+18:11293:x1875360064048384:12345-192.168.201.6@tcp:60:lhsmtool_posix.0 Request processed in 95us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483026.832615:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 238 00000100:00080000:3.0:1788483026.832636:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483026.838481:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483026.838661:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064048640 00000100:00100000:2.0:1788483026.838675:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064048640 00000100:00100000:2.0:1788483026.838798:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:2.0:1788483026.838810:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+18:11293:x1875360064048640:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788483026.839505:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+19:11293:x1875360064048640:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 684us (1021us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788483026.839523:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 65 00000100:00100000:1.0:1788483026.866738:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072419456:0@lo:400:kworker.0 00000100:00100000:2.0:1788483026.866761:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072419712:0@lo:400:kworker.0 00000100:00100000:0.0:1788483026.866847:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072419840:0@lo:400:kworker.0 00000100:00100000:2.0:1788483026.866891:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483026.866953:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788483026.866959:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072419584:0@lo:400:kworker.0 00000100:00100000:2.0:1788483026.866983:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483026.867001:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072420096:0@lo:400:kworker.0 00000100:00100000:2.0:1788483026.867027:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483026.873442:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483026.874499:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072419456 00000100:00100000:3.0:1788483026.874514:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072419456 00000100:00100000:3.0:1788483026.874580:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788483026.874595:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072419456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483026.874679:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072419968:0@lo:400:kworker.0 00000100:00100000:3.0:1788483026.874681:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072419456:12345-0@lo:400:kworker.0 Request processed in 90us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483026.874694:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788483026.874735:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483026.874798:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072419456:0@lo:400:kworker.0 00000100:00100000:3.0:1788483026.874819:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072419712 00000100:00100000:3.0:1788483026.874825:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072419712 00000100:00100000:1.0:1788483026.874842:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072419584 00000100:00100000:1.0:1788483026.874848:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072419584 00000100:00100000:3.0:1788483026.874862:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072419968 00000100:00100000:3.0:1788483026.874867:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072419968 00000100:00100000:1.0:1788483026.874875:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788483026.874885:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072419712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483026.874891:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788483026.874900:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072419584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483026.874933:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072419712:12345-0@lo:400:kworker.0 Request processed in 49us (8041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483026.874940:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788483026.874955:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788483026.874963:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072419968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483026.874969:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072419584:12345-0@lo:400:kworker.0 Request processed in 69us (7983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483026.874978:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1788483026.875000:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483026.875001:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072419968:12345-0@lo:400:kworker.0 Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483026.875009:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788483026.875044:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072419584:0@lo:400:kworker.0 00000100:00100000:1.0:1788483026.875072:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072419712:0@lo:400:kworker.0 00000100:00100000:1.0:1788483026.875111:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072419968:0@lo:400:kworker.0 00000100:00100000:0.0:1788483026.875976:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483026.876039:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072420096 00000100:00100000:0.0:1788483026.876045:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072420096 00000100:00100000:0.0:1788483026.876094:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072419840 00000100:00100000:0.0:1788483026.876097:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072419840 00000100:00100000:0.0:1788483026.876115:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788483026.876123:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9406f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072420096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483026.876167:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9406f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072420096:12345-0@lo:400:kworker.0 Request processed in 44us (9139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483026.876173:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788483026.876186:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788483026.876191:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072419840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483026.876214:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072419840:12345-0@lo:400:kworker.0 Request processed in 23us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483026.876220:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788483026.876284:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483026.876289:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788483026.876296:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072420096:0@lo:400:kworker.0 00000100:00100000:0.0:1788483026.876322:0:3279:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788483026.876328:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb936d1a680, transno 4294967322 00000004:00080000:0.0:1788483026.876345:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788483026.876364:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072419840:0@lo:400:kworker.0 00000100:00100000:1.0:1788483027.052677:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483027.052777:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064048768 00000100:00100000:3.0:1788483027.052789:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064048768 00000100:00100000:3.0:1788483027.052879:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 239 00000100:00100000:3.0:1788483027.052891:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+5:12092:x1875360064048768:12345-192.168.201.6@tcp:101:lsof.0 00010000:00010000:3.0:1788483027.052915:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483027.052940:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad79b13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077d8e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483027.053009:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79b1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483027.053024:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483027.053038:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483027.053300:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788483027.053304:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483027.053399:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483027.053428:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15800/0x42820277aad79b13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d8e expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483027.053448:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d8e expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483027.053465:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483027.053468:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483027.053473:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14800, rc 0) 00000100:00100000:3.0:1788483027.053663:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5778eeb0-8512-44ab-a78a-f60f28116302+6:12092:x1875360064048768:12345-192.168.201.6@tcp:101:lsof.0 Request processed in 773us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483027.053671:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 239 00000100:00080000:1.0:1788483027.055338:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483027.380318:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072420224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483027.380442:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483027.380769:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072420224 00000100:00100000:0.0:1788483027.380799:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072420224 00000100:00100000:0.0:1788483027.380876:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788483027.380887:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072420224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483027.380934:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483027.381006:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072420224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483027.381015:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788483027.381213:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072420224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788483027.827743:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483028.403990:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483028.404013:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072420352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483028.404093:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483028.405397:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072420352 00000100:00100000:0.0:1788483028.405410:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072420352 00000100:00100000:0.0:1788483028.405505:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788483028.405517:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072420352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483028.405557:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483028.405636:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072420352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483028.405644:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788483028.406040:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072420352:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788483028.406388:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483028.443977:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483028.444043:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483028.444087:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483028.444119:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483028.444147:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483028.444305:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064048896 00000100:00100000:2.0:1788483028.444317:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064048896 00000100:00100000:2.0:1788483028.444379:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 303 00000100:00100000:2.0:1788483028.444390:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064048896:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788483028.444483:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064048896:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 95us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483028.444492:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 303 00000100:00100000:0.0:1788483028.444693:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064049152 00000100:00100000:0.0:1788483028.444714:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064049152 00000100:00100000:0.0:1788483028.444765:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064049280 00000100:00100000:0.0:1788483028.444779:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064049280 00000100:00100000:0.0:1788483028.444804:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:0.0:1788483028.444811:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064049152:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483028.444850:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+7:2351:x1875360064049152:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 40us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483028.444856:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 102 00000100:00100000:0.0:1788483028.444869:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:0.0:1788483028.444875:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360064049280:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483028.444917:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360064049280:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 43us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483028.444923:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:0.0:1788483028.444945:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064049024 00000100:00100000:0.0:1788483028.444948:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064049024 00000100:00100000:0.0:1788483028.444971:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064049408 00000100:00100000:0.0:1788483028.444974:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064049408 00000100:00100000:0.0:1788483028.444992:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:0.0:1788483028.444998:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+19:2352:x1875360064049024:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483028.445031:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+19:2352:x1875360064049024:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 33us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483028.445038:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:0.0:1788483028.445049:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:0.0:1788483028.445055:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb908700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+6:2351:x1875360064049408:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483028.445079:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb908700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+6:2351:x1875360064049408:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483028.445085:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00080000:2.0:1788483028.445609:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788483028.445614:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483028.445616:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788483028.850473:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483029.874411:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788483029.980967:0:12743:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:50:28 (1788483028) 00010000:00010000:0.0:1788483030.900232:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788483031.058715:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788483031.058732:0:5829:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788483031.058747:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788483031.058758:0:5840:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788483031.922497:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483031.989591:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072420480:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.989696:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483031.989758:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072420992:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.989793:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483031.989822:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788483031.989828:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072420864:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.989853:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483031.989899:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072420608:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.989923:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483031.989949:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072421120:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.989968:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483031.989988:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483031.989994:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072420736:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990016:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483031.990051:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072420480 00000100:00100000:2.0:1788483031.990062:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072420480 00000100:00100000:2.0:1788483031.990114:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788483031.990125:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072420480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990200:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072420480:12345-0@lo:400:kworker.0 Request processed in 77us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483031.990208:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788483031.990244:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072420992 00000100:00100000:2.0:1788483031.990276:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072420992 00000100:00100000:2.0:1788483031.990309:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072420608 00000100:00100000:2.0:1788483031.990311:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072420608 00000100:00100000:2.0:1788483031.990322:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072420736 00000100:00100000:2.0:1788483031.990324:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072420736 00000100:00100000:2.0:1788483031.990337:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788483031.990343:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072420992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990375:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072420992:12345-0@lo:400:kworker.0 Request processed in 33us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483031.990382:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788483031.990393:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788483031.990399:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072420608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990445:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072420608:12345-0@lo:400:kworker.0 Request processed in 47us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483031.990452:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788483031.990465:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788483031.990471:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072420736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990497:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072420736:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483031.990504:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788483031.990525:0:12501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072420864 00000100:00100000:2.0:1788483031.990529:0:12501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072420864 00000100:00100000:2.0:1788483031.990559:0:12501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072421120 00000100:00100000:2.0:1788483031.990562:0:12501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072421120 00000100:00100000:2.0:1788483031.990583:0:12501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788483031.990588:0:12501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072420864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990622:0:12501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072420864:12345-0@lo:400:kworker.0 Request processed in 34us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483031.990628:0:12501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788483031.990639:0:12501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788483031.990644:0:12501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93728c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072421120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990667:0:12501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93728c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072421120:12345-0@lo:400:kworker.0 Request processed in 23us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483031.990673:0:12501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788483031.990719:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072420864:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990730:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072420480:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990740:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072420992:0@lo:400:kworker.0 00000100:00080000:2.0:1788483031.990779:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788483031.990783:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483031.990785:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483031.990801:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072420736:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990811:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072420608:0@lo:400:kworker.0 00000100:00100000:2.0:1788483031.990819:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072421120:0@lo:400:kworker.0 00000100:00100000:1.0:1788483032.498592:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788483032.498624:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072421248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483032.498716:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483032.498867:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072421248 00000100:00100000:0.0:1788483032.498877:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072421248 00000100:00100000:0.0:1788483032.498943:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788483032.498955:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072421248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483032.498998:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483032.499065:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072421248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483032.499092:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788483032.499192:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072421248:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788483032.947868:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483033.522775:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483033.522808:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072421376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788483033.522906:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483033.523115:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072421376 00000100:00100000:0.0:1788483033.523125:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072421376 00000100:00100000:0.0:1788483033.523208:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788483033.523222:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072421376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483033.523288:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483033.523345:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072421376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483033.523352:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788483033.523403:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072421376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788483033.523719:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483033.571244:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483033.571347:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483033.571392:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483033.571827:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483033.571886:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064049536 00000100:00100000:0.0:1788483033.571896:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064049536 00000100:00100000:0.0:1788483033.571987:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 305 00000100:00100000:0.0:1788483033.571999:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360064049536:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483033.572089:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2352:x1875360064049536:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 92us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483033.572098:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 305 00000100:00100000:1.0:1788483033.572439:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064049792 00000100:00100000:1.0:1788483033.572446:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064049792 00000100:00100000:1.0:1788483033.572519:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:1.0:1788483033.572527:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064049792:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483033.572569:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa30c745-265d-4a44-8753-67e411452897+7:2352:x1875360064049792:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 43us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483033.572576:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00080000:0.0:1788483033.572914:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483033.580372:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483033.581114:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064050048 00000100:00100000:2.0:1788483033.581127:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064050048 00000100:00100000:2.0:1788483033.581225:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064049664 00000100:00100000:2.0:1788483033.581229:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064049664 00000100:00100000:2.0:1788483033.581275:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:2.0:1788483033.581286:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93704df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+6:2352:x1875360064050048:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788483033.581367:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93704df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5778eeb0-8512-44ab-a78a-f60f28116302+6:2352:x1875360064050048:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 83us (9974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483033.581375:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:2.0:1788483033.581393:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00100000:2.0:1788483033.581400:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+18:2352:x1875360064049664:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788483033.581424:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+18:2352:x1875360064049664:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 25us (9598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483033.581431:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00080000:3.0:1788483033.582122:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483033.582198:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064049920 00000100:00100000:1.0:1788483033.582206:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064049920 00000100:00100000:1.0:1788483033.582286:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:1.0:1788483033.582296:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360064049920:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483033.582349:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa30c745-265d-4a44-8753-67e411452897+5:2352:x1875360064049920:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 56us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483033.582358:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00080000:3.0:1788483033.582525:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788483033.971741:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483034.038906:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788483034.038916:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788483034.041090:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788483034.041107:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788483034.847313:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483034.847428:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064050304 00000100:00100000:0.0:1788483034.847440:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064050304 00000100:00100000:0.0:1788483034.847507:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:0.0:1788483034.847518:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+18:12314:x1875360064050304:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:0.0:1788483034.848091:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+19:12314:x1875360064050304:12345-192.168.201.6@tcp:35:umount.0 Request processed in 573us (787us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788483034.848110:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 66 00000100:00100000:1.0:1788483034.854388:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483034.855334:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064050560 00000100:00100000:0.0:1788483034.855364:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064050560 00000100:00100000:0.0:1788483034.855446:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:0.0:1788483034.855458:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+19:12314:x1875360064050560:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:0.0:1788483034.856310:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+20:12314:x1875360064050560:12345-192.168.201.6@tcp:35:umount.0 Request processed in 849us (1927us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788483034.856321:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 67 00000100:00100000:3.0:1788483034.861392:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483034.861584:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064050816 00000100:00100000:0.0:1788483034.861595:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064050816 00000100:00100000:0.0:1788483034.861653:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:0.0:1788483034.861668:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb918844850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+20:12314:x1875360064050816:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:0.0:1788483034.862137:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb918844850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa30c745-265d-4a44-8753-67e411452897+21:12314:x1875360064050816:12345-192.168.201.6@tcp:35:umount.0 Request processed in 465us (747us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788483034.862146:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 68 00000100:00100000:3.0:1788483034.866446:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483034.871718:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064051072 00000100:00100000:2.0:1788483034.871749:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064051072 00000100:00100000:2.0:1788483034.871856:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:2.0:1788483034.871867:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+21:12314:x1875360064051072:12345-192.168.201.6@tcp:35:umount.0 00000100:00100000:2.0:1788483034.872287:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa30c745-265d-4a44-8753-67e411452897+22:12314:x1875360064051072:12345-192.168.201.6@tcp:35:umount.0 Request processed in 420us (5853us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788483034.872295:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 69 00000100:00100000:1.0:1788483034.877598:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483034.877640:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483034.877664:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483034.877689:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483034.877716:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064051200 00000100:00100000:1.0:1788483034.877726:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064051200 00000100:00100000:1.0:1788483034.877779:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064051456 00000100:00100000:1.0:1788483034.877783:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064051456 00000100:00100000:1.0:1788483034.877796:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064051328 00000100:00100000:1.0:1788483034.877798:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064051328 00000100:00100000:1.0:1788483034.877814:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788483034.877823:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+15:2351:x1875360064051200:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483034.877857:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483034.877878:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f781e00/0x42820277aad78b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077919 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483034.877895:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483034.877941:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+14:2351:x1875360064051200:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 118us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.877948:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788483034.877965:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788483034.877972:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+13:2351:x1875360064051456:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483034.877980:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483034.877989:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f780800/0x42820277aad78da6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779e4 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483034.877998:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483034.878016:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+12:2351:x1875360064051456:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 45us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.878023:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788483034.878036:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788483034.878042:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+11:2351:x1875360064051328:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483034.878049:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483034.878058:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901493800/0x42820277aad78af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70778e1 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483034.878066:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483034.878098:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2351:x1875360064051328:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 56us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.878111:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788483034.878147:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064051584 00000100:00100000:1.0:1788483034.878151:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064051584 00000100:00100000:1.0:1788483034.878274:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 72 00000100:00100000:1.0:1788483034.878283:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+5:2350:x1875360064051584:12345-192.168.201.6@tcp:9:umount.0 00000020:00000080:1.0:1788483034.878306:0:6663:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78e6a 00000100:00080000:1.0:1788483034.878315:0:6663:0:(import.c:65:import_set_state_nolock()) ffff9eb936e2e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788483034.878352:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788483034.878598:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa30c745-265d-4a44-8753-67e411452897+2:2350:x1875360064051584:12345-192.168.201.6@tcp:9:umount.0 Request processed in 316us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.878605:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 72 00010000:00010000:1.0:1788483034.878627:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483034.893775:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483034.893876:0:12501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064051968 00000100:00100000:1.0:1788483034.893888:0:12501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064051968 00000100:00100000:1.0:1788483034.893962:0:12501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 73 00000100:00100000:1.0:1788483034.893975:0:12501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa30c745-265d-4a44-8753-67e411452897+7:2350:x1875360064051968:12345-192.168.201.6@tcp:9:umount.0 00000020:00000080:1.0:1788483034.894016:0:12501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad790d2 00000020:00010000:1.0:1788483034.894025:0:12501:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9eb910c19000: total 0 00000100:00080000:1.0:1788483034.894030:0:12501:0:(import.c:65:import_set_state_nolock()) ffff9eb910c1c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788483034.894092:0:12501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788483034.894479:0:12501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aa30c745-265d-4a44-8753-67e411452897+5:2350:x1875360064051968:12345-192.168.201.6@tcp:9:umount.0 Request processed in 504us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483034.894487:0:12501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 73 00000020:00010000:3.0:1788483034.894685:0:8489:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9eb910c19000: total 0 00010000:00010000:3.0:1788483034.894725:0:8489:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eb910c19000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788483034.894794:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009287900b/0x42820277aad79b0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d87 expref: 4 pid: 6663 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483034.894831:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6c2ed3a/0x42820277aad7946e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bb9 expref: 3 pid: 6662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483034.894845:0:8489:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eb910c19000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788483034.894856:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483034.894858:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483034.894860:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483034.912384:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483034.912545:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064052992 00000100:00100000:2.0:1788483034.912557:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064052992 00000100:00100000:2.0:1788483034.912627:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 240 00000100:00100000:2.0:1788483034.912638:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+22:2350:x1875360064052992:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:2.0:1788483034.912677:0:5809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78b06 00000020:00010000:2.0:1788483034.912695:0:5809:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9eb937ddf800: total 0 00000100:00080000:2.0:1788483034.912699:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9eb9087de000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483034.912722:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788483034.913150:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa30c745-265d-4a44-8753-67e411452897+21:2350:x1875360064052992:12345-192.168.201.6@tcp:39:umount.0 Request processed in 511us (778us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788483034.913160:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 240 00000020:00010000:0.0:1788483034.913482:0:5797:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9eb937ddf800: total 0 00010000:00010000:0.0:1788483034.913529:0:5797:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eb937ddf800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788483034.913565:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:0.0:1788483034.913569:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483034.913577:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493600/0x42820277aad794d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bd5 expref: 20 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913598:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb911fa9600) 00010000:00010000:0.0:1788483034.913601:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483034.913605:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781400/0x42820277aad78dec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779f9 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913647:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:0.0:1788483034.913650:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788483034.913653:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901492e00/0x42820277aad79459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bb2 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913666:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788483034.913668:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483034.913671:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368e00/0x42820277aad79acd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d72 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913681:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788483034.913683:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788483034.913687:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c66a00/0x42820277aad79af7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d80 expref: 16 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913698:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:0.0:1788483034.913700:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483034.913704:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7942f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ba4 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913715:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eb911fa9f00) 00010000:00010000:0.0:1788483034.913717:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788483034.913721:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad78dd0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779f2 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913737:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483034.913739:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788483034.913749:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493000/0x42820277aad797cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077cae expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913765:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:0.0:1788483034.913767:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788483034.913771:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb901493a00/0x42820277aad7912d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ae0 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913782:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9eb907174600) 00010000:00010000:0.0:1788483034.913784:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788483034.913788:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad794ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077bdc expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913802:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9eb911fa9100) 00010000:00010000:0.0:1788483034.913804:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483034.913808:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7934f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077b6c expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913822:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9eb911fa9b00) 00010000:00010000:0.0:1788483034.913825:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788483034.913828:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad78e40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077a0e expref: 9 pid: 6958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913842:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9eb907174300) 00010000:00010000:0.0:1788483034.913845:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788483034.913848:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad799ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d3a expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483034.913860:0:5797:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eb937ddf800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788483034.913887:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483034.913889:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483034.913891:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483034.995555:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483036.018651:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788483036.152626:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1788483036.152662:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000001:00080000:0.0:1788483036.152668:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788483036.152674:0:5829:0:(genops.c:885:class_export_put()) final put ffff9eb937ddf800/aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:3.0:1788483036.152789:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb937ddf800/aa30c745-265d-4a44-8753-67e411452897 for lustre-MDT0000 00000020:00000080:3.0:1788483036.153465:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb9087de000 for lustre-MDT0000 00000001:00100000:2.0:1788483036.205512:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:2.0:1788483036.205527:0:6686:0:(genops.c:885:class_export_put()) final put ffff9eb910c19000/aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:0.0:1788483036.205824:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb910c19000/aa30c745-265d-4a44-8753-67e411452897 for lustre-OST0000 00000020:00000080:0.0:1788483036.205903:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb910c1c000 for lustre-OST0000 00000100:00100000:0.0:1788483036.620858:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483036.621185:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064053120 00000100:00100000:1.0:1788483036.621198:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064053120 00000100:00100000:1.0:1788483036.621328:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:1.0:1788483036.621342:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+10:2354:x1875360064053120:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483036.621363:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483036.621389:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492600/0x42820277aad78bd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe707792e expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483036.621413:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483036.621500:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:2354:x1875360064053120:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 160us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483036.621508:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1788483036.633728:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483036.637773:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064053248 00000100:00100000:1.0:1788483036.637797:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064053248 00000100:00100000:1.0:1788483036.639631:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1788483036.639658:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9243b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4e829f8-ccd7-488a-828b-8ba668cc410b+9:2352:x1875360064053248:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483036.639688:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483036.639717:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f627800/0x42820277aad78bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077958 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483036.639737:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483036.642379:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9243b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:2352:x1875360064053248:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 2717us (8649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483036.642398:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1788483036.643088:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483036.643392:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064053376 00000100:00100000:1.0:1788483036.643460:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064053376 00000100:00100000:1.0:1788483036.643697:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:1.0:1788483036.643710:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+8:2352:x1875360064053376:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483036.643729:0:8490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483036.643775:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb907368a00/0x42820277aad78d9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe70779dd expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483036.643798:0:8490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483036.643884:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4e829f8-ccd7-488a-828b-8ba668cc410b+7:2352:x1875360064053376:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 177us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483036.643892:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:0.0:1788483036.669510:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483036.669677:0:6958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064053632 00000100:00100000:2.0:1788483036.669692:0:6958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064053632 00000100:00080000:3.0:1788483036.669790:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483036.669792:0:6958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 241 00000100:00100000:2.0:1788483036.669805:0:6958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+6:2350:x1875360064053632:12345-192.168.201.6@tcp:39:umount.0 00000020:00000080:2.0:1788483036.669862:0:6958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78bed 00000020:00010000:2.0:1788483036.669873:0:6958:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9eb908625000: total 0 00000100:00080000:2.0:1788483036.669878:0:6958:0:(import.c:65:import_set_state_nolock()) ffff9eb93ff2f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788483036.669921:0:6958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1788483036.670639:0:6958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5778eeb0-8512-44ab-a78a-f60f28116302+5:2350:x1875360064053632:12345-192.168.201.6@tcp:39:umount.0 Request processed in 833us (1143us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788483036.670650:0:6958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 241 00000020:00010000:1.0:1788483036.670759:0:5797:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9eb908625000: total 0 00010000:00010000:1.0:1788483036.670765:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483036.670826:0:5797:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eb908625000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788483036.670869:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb9231ebe00) 00010000:00010000:1.0:1788483036.670874:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483036.670884:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad79b1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077d8e expref: 4 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483036.670915:0:5797:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eb908625000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788483036.670926:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483036.670928:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483036.670930:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483036.717745:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483036.717962:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064053888 00000100:00100000:2.0:1788483036.717976:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064053888 00000100:00100000:2.0:1788483036.718137:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 306 00000100:00100000:2.0:1788483036.718161:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+7:2350:x1875360064053888:12345-192.168.201.6@tcp:251:umount.0 00000020:00000080:2.0:1788483036.718229:0:5800:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78ae3 00000020:00010000:2.0:1788483036.718241:0:5800:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9eb9087d8800: total 0 00000100:00080000:2.0:1788483036.718284:0:5800:0:(import.c:65:import_set_state_nolock()) ffff9eb9087dd800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788483036.718414:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4e829f8-ccd7-488a-828b-8ba668cc410b+3:2350:x1875360064053888:12345-192.168.201.6@tcp:251:umount.0 Request processed in 256us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483036.718423:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 306 00000020:00010000:1.0:1788483036.718977:0:5796:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9eb9087d8800: total 0 00010000:00010000:1.0:1788483036.719055:0:5796:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eb9087d8800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788483036.719114:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900031e00/0x42820277aad78b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077920 expref: 2 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483036.719137:0:5796:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eb9087d8800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788483036.719149:0:5796:0:(genops.c:885:class_export_put()) final put ffff9eb9087d8800/b4e829f8-ccd7-488a-828b-8ba668cc410b 00010000:00010000:1.0:1788483036.719167:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483036.719169:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483036.719171:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788483036.719631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb9087d8800/b4e829f8-ccd7-488a-828b-8ba668cc410b for MGS 00000020:00000080:3.0:1788483036.719692:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb9087dd800 for MGS 00010000:00010000:3.0:1788483037.044783:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483037.109466:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072421504:0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.109561:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483037.109608:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072422016:0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.109631:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483037.109654:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483037.109658:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072421888:0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.109679:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483037.109705:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072421504 00000100:00100000:0.0:1788483037.109712:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072421504 00000100:00100000:0.0:1788483037.109750:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788483037.109758:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072421504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.109798:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9030fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3280:x1875360072421504:12345-0@lo:400:kworker.0 Request processed in 41us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.109804:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788483037.109843:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072421504:0@lo:400:kworker.0 00000100:00100000:3.0:1788483037.111123:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072421632:0@lo:400:kworker.0 00000100:00100000:3.0:1788483037.111188:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483037.119907:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072421888 00000100:00100000:3.0:1788483037.119925:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072421888 00000100:00100000:3.0:1788483037.120031:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788483037.120064:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072421888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483037.120181:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072421888:12345-0@lo:400:kworker.0 Request processed in 121us (10500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483037.120189:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1788483037.120222:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483037.120288:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072421888:0@lo:400:kworker.0 00000100:00100000:3.0:1788483037.120359:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072422144:0@lo:400:kworker.0 00000100:00100000:3.0:1788483037.120403:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483037.120428:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072422144 00000100:00100000:3.0:1788483037.120432:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072422144 00000100:00100000:3.0:1788483037.120471:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788483037.120478:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072422144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483037.122646:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072422144:12345-0@lo:400:kworker.0 Request processed in 2159us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483037.122661:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788483037.122707:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483037.122747:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072422144:0@lo:400:kworker.0 00000100:00100000:3.0:1788483037.122773:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788483037.122782:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072421760:0@lo:400:kworker.0 00000100:00100000:3.0:1788483037.122816:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483037.133298:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072422016 00000100:00100000:0.0:1788483037.133315:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072422016 00000100:00100000:0.0:1788483037.133394:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072421632 00000100:00100000:0.0:1788483037.133398:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072421632 00000100:00100000:0.0:1788483037.133412:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072421760 00000100:00100000:0.0:1788483037.133414:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072421760 00000100:00100000:0.0:1788483037.133440:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788483037.133452:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9071b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072422016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.133603:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9071b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072422016:12345-0@lo:400:kworker.0 Request processed in 153us (23970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.133612:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788483037.133632:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788483037.133638:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072421632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.133679:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072421632:12345-0@lo:400:kworker.0 Request processed in 41us (22491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.133685:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788483037.133697:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788483037.133704:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072421760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.133733:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072421760:12345-0@lo:400:kworker.0 Request processed in 30us (10916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.133739:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1788483037.133761:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483037.133812:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072422016:0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.133852:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072421760:0@lo:400:kworker.0 00000100:00100000:0.0:1788483037.133863:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072421632:0@lo:400:kworker.0 00000001:00100000:0.0:1788483037.270129:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:0.0:1788483037.270144:0:7620:0:(genops.c:885:class_export_put()) final put ffff9eb936e2d000/aa30c745-265d-4a44-8753-67e411452897 00000020:00000080:2.0:1788483037.270279:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb936e2d000/aa30c745-265d-4a44-8753-67e411452897 for lustre-OST0001 00000020:00000080:2.0:1788483037.270363:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb936e2e000 for lustre-OST0001 00000100:00100000:0.0:1788483037.629671:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483037.629697:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072422272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483037.629764:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483037.629837:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072422272 00000100:00100000:0.0:1788483037.629845:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072422272 00000100:00100000:0.0:1788483037.629942:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788483037.629953:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072422272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483037.629987:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483037.630031:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072422272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483037.630038:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788483037.630099:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072422272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788483038.066530:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483038.643850:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483038.643882:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072422400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483038.644005:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483038.644114:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072422400 00000100:00100000:0.0:1788483038.644124:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072422400 00000100:00100000:0.0:1788483038.644198:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788483038.644208:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072422400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483038.644278:0:6665:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483038.644476:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072422400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 268us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483038.644485:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788483038.644613:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072422400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788483039.090417:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788483039.302869:0:12949:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788483039.309474:0:12949:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788483039.309527:0:12949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.309543:0:12949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.309552:0:12949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.309560:0:12949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.309589:0:12949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788483039.309603:0:12949:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788483039.309629:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788483039.309636:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788483039.309643:0:12949:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788483039.309670:0:12949:0:(import.c:65:import_set_state_nolock()) ffff9eb937ed3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788483039.309723:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072422528:0@lo:39:umount.0 00000100:00100000:2.0:1788483039.309800:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483039.310449:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483039.310459:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.310469:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626200 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788483039.310473:0:8489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.310482:0:8489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483039.310489:0:8489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483039.310494:0:8489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483039.310497:0:8489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788483039.310500:0:8489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788483039.310530:0:8489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.310537:0:8489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483039.310560:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.310567:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f626200/0x42820277aad78b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b7d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.310582:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483039.310584:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483039.310586:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483039.310606:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072422528 00000100:00100000:0.0:1788483039.310626:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072422528 00000100:00100000:0.0:1788483039.310688:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788483039.310698:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875360072422528:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788483039.310723:0:5809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad788f2 00000100:00080000:0.0:1788483039.310731:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9eb93727b800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788483039.310812:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3276:x1875360072422528:12345-0@lo:39:umount.0 Request processed in 115us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.310819:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788483039.310830:0:5809:0:(genops.c:885:class_export_put()) final put ffff9eb93727d000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1788483039.310854:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483039.310866:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072422656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483039.310900:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788483039.310942:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788483039.310952:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93727d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788483039.311013:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb93727b800 for lustre-MDT0000 00000100:00100000:0.0:1788483039.311030:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072422656 00000100:00100000:0.0:1788483039.311034:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072422656 00000100:00100000:0.0:1788483039.311082:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788483039.311090:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3279:x1875360072422656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483039.311100:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483039.311116:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f780200/0x42820277aad78b7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78b76 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.311129:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483039.311158:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:3279:x1875360072422656:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.311165:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788483039.311210:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072422656:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788483039.312490:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb937ed3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788483039.312550:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072422528:0@lo:39:umount.0 00000100:00080000:2.0:1788483039.321151:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788483039.321164:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788483039.321175:0:12949:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788483039.322940:0:12949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.322960:0:12949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.322968:0:12949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.322974:0:12949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323000:0:12949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483039.323006:0:12949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323012:0:12949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323018:0:12949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323038:0:12949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323064:0:12949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788483039.323072:0:12949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323078:0:12949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323084:0:12949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323090:0:12949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323100:0:12949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788483039.323105:0:12949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323111:0:12949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323117:0:12949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323122:0:12949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483039.323139:0:12949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788483039.323142:0:12949:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788483039.323175:0:12949:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788483039.323179:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788483039.323183:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483039.323187:0:12949:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1788483039.323194:0:12949:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9eb937ddd000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483039.323200:0:12949:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9eb93f38f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483039.323207:0:12949:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9eb908625000 5778eeb0-8512-44ab-a78a-f60f28116302 192.168.201.6@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483039.323212:0:12949:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9eb92ec519b8) has exports, disconnecting them 00000020:00080000:2.0:1788483039.323216:0:12949:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eb937ddd000), last request at 1788483037 00000020:00000080:2.0:1788483039.323223:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78a65 00000100:00080000:2.0:1788483039.323263:0:12949:0:(import.c:65:import_set_state_nolock()) ffff9eb937ddc000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788483039.323397:0:12949:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eb937ddd000): rc 0 00000020:00000080:2.0:1788483039.323400:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb937ddd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788483039.323409:0:12949:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9eb93f38f800), last request at 1788483037 00000020:00000080:2.0:1788483039.323412:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad7899a 00000100:00080000:2.0:1788483039.323418:0:12949:0:(import.c:65:import_set_state_nolock()) ffff9eb93f38d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788483039.323424:0:12949:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eb93f38f800): rc 0 00000020:00000080:2.0:1788483039.323426:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb93f38f800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788483039.323433:0:12949:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc16681d17ae0 00000100:00080000:2.0:1788483039.323454:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788483039.323457:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788483039.323468:0:12949:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788483039.323527:0:12949:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788483039.323548:0:12949:0:(import.c:65:import_set_state_nolock()) ffff9eb908622000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1788483039.323729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb937ddd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788483039.323769:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93f38f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788483039.323786:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb937ddc000 for lustre-MDT0000 00000020:00000080:0.0:1788483039.323791:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb93f38d800 for lustre-MDT0000 00010000:00010000:0.0:1788483039.323799:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788483039.323805:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323813:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780400 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788483039.323817:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323826:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483039.323833:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483039.323839:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483039.323842:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788483039.323845:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788483039.323871:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323877:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483039.323901:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323919:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f780400/0x42820277aad78b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323932:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788483039.323935:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323940:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb9421d2e00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788483039.323943:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323950:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483039.323957:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483039.323962:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483039.323964:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788483039.323966:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788483039.323979:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323985:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483039.323991:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.323997:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2e00/0x42820277aad78a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324019:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483039.324023:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324029:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369600 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788483039.324032:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324039:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483039.324045:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483039.324062:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788483039.324065:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788483039.324066:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788483039.324080:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324086:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483039.324102:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324108:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb907369600/0x42820277aad78d91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78d98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324116:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483039.324118:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324130:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b800 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788483039.324133:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324139:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483039.324146:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483039.324150:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483039.324153:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788483039.324155:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788483039.324182:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324188:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788483039.324194:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324201:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb94204b800/0x42820277aad78851 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78858 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324213:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483039.324214:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483039.324216:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483039.324236:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072422912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483039.324345:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.324465:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483039.324481:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072423040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483039.324510:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.324550:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072423296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483039.324578:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.324600:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788483039.324606:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072423168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483039.324630:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.324659:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072422912 00000100:00100000:0.0:1788483039.324667:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072422912 00000100:00100000:0.0:1788483039.324709:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072423040 00000100:00100000:0.0:1788483039.324713:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072423040 00000100:00100000:0.0:1788483039.324726:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072423296 00000100:00100000:0.0:1788483039.324729:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072423296 00000100:00100000:0.0:1788483039.324741:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072423168 00000100:00100000:0.0:1788483039.324744:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072423168 00000100:00100000:0.0:1788483039.324758:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788483039.324767:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+21:3277:x1875360072422912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483039.324781:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483039.324800:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900031800/0x42820277aad78b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78b84 expref: 21 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324822:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483039.324868:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+20:3277:x1875360072422912:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.324876:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788483039.324895:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788483039.324902:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+19:3277:x1875360072423040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483039.324909:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483039.324925:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d3800/0x42820277aad78aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78a9d expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.324944:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483039.324968:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+18:3277:x1875360072423040:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.324974:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788483039.324985:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483039.324990:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+17:3280:x1875360072423296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483039.324996:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483039.325004:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901493e00/0x42820277aad78858 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78851 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.325014:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483039.325033:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+16:3280:x1875360072423296:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.325038:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483039.325065:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788483039.325071:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+15:3280:x1875360072423168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483039.325080:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483039.325091:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f781200/0x42820277aad78d98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78d91 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483039.325102:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483039.325126:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30+14:3280:x1875360072423168:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483039.325133:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788483039.325194:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93f160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072423168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483039.325216:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3280:1875360072423296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483039.325274:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483039.325299:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9406f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072423040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483039.325312:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb937066d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3277:1875360072422912:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788483039.325595:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788483039.325599:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788483039.325612:0:12949:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788483039.325679:0:12949:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788483039.325696:0:12949:0:(import.c:65:import_set_state_nolock()) ffff9eb92163a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788483039.325730:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9eb92ec519b8) has no exports 00010000:00010000:1.0:1788483039.325858:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483039.326108:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072422784:0@lo:9:umount.0 00000100:00100000:0.0:1788483039.326160:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483039.326199:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072423424:0@lo:9:umount.0 00000100:00100000:0.0:1788483039.326220:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483039.326374:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072422784 00000100:00100000:1.0:1788483039.326382:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072422784 00000100:00100000:1.0:1788483039.326444:0:12045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072423424 00000100:00100000:1.0:1788483039.326447:0:12045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072423424 00000100:00100000:3.0:1788483039.326465:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788483039.326478:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875360072422784:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788483039.326551:0:6660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad789ee 00000100:00080000:3.0:1788483039.326563:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9eb9056f6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788483039.326599:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788483039.327245:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3276:x1875360072422784:12345-0@lo:9:umount.0 Request processed in 768us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483039.327408:0:12045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788483039.327419:0:12045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875360072423424:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788483039.327435:0:12045:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78ad5 00000100:00080000:1.0:1788483039.327441:0:12045:0:(import.c:65:import_set_state_nolock()) ffff9eb9056f2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788483039.327463:0:12045:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788483039.327616:0:12045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3276:x1875360072423424:12345-0@lo:9:umount.0 Request processed in 200us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483039.327621:0:12045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788483039.327636:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788483039.327639:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483039.327854:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788483039.327938:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483039.328219:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb908622000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788483039.328245:0:3276:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788483039.328268:0:3276:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483039.328272:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072422784:0@lo:9:umount.0 00000100:00080000:0.0:1788483039.328289:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb92163a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788483039.328300:0:3276:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788483039.328301:0:3276:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788483039.328304:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072423424:0@lo:9:umount.0 00010000:00010000:0.0:1788483039.328338:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788483039.334513:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9eb92ec519b8) has no exports 00000020:00000080:2.0:1788483039.377291:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad788ac 00000020:00000080:2.0:1788483039.377310:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb92ec41800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788483039.377324:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788483039.377416:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483039.377447:0:12949:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788483039.377454:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9eb920880000) has no exports 00000020:00000080:0.0:1788483039.378176:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92ec41800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788483039.380032:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad788a5 00000020:00000080:3.0:1788483039.380061:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb92f761800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788483039.380137:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483039.380152:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788483039.380156:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb918378000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788483039.380159:0:12949:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb918378000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788483039.380166:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788483039.381156:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92f761800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788483040.114521:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483041.148391:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788483041.268010:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788483041.268032:0:6686:0:(genops.c:885:class_export_put()) final put ffff9eb9056f5000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788483041.268296:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5778eeb0-8512-44ab-a78a-f60f28116302 00000001:00080000:0.0:1788483041.268311:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788483041.268316:0:5829:0:(genops.c:885:class_export_put()) final put ffff9eb908625000/5778eeb0-8512-44ab-a78a-f60f28116302 00000020:00000080:3.0:1788483041.268372:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb9056f5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788483041.268441:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb908625000/5778eeb0-8512-44ab-a78a-f60f28116302 for lustre-MDT0000 00000020:00000080:3.0:1788483041.268522:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb9056f6800 for lustre-OST0000 00000020:00000080:3.0:1788483041.268529:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb93ff2f800 for lustre-MDT0000 00000020:01000000:3.0:1788483041.397045:0:12949:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eb9186ff120 - data ffff9eb93f850870/ffff9eb93febf000 00000020:01000000:3.0:1788483041.397212:0:12949:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eb902e6c660 - data ffff9eb93182e288/ffff9eb904c19000 00000001:00000004:3.0:1788483041.408787:0:12949:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:1.0:1788483041.505121:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788483041.505133:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788483041.505584:0:12949:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788483041.505588:0:12949:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788483041.507696:0:6977:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788483041.507706:0:6977:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788483041.507720:0:6977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788483041.523880:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788483041.523967:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788483041.524219:0:12949:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788483041.524223:0:12949:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788483041.535454:0:7872:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788483041.535466:0:7872:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788483041.535482:0:7872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788483041.641108:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78874 00000020:00000080:3.0:1788483041.641125:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb937278800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788483041.643018:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb937278800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788483041.643194:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78889 00000020:00000080:3.0:1788483041.643205:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb92ec47000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788483041.643214:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788483041.643221:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483041.643241:0:12949:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788483041.643266:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9eb92ec53370) has no exports 00000004:01000000:3.0:1788483041.643739:0:12949:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788483041.643751:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78ac7 00000020:00000080:3.0:1788483041.643756:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb92163b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788483041.643761:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788483041.643764:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483041.643871:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92ec47000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788483041.643950:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92163b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788483041.643986:0:12949:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788483041.643989:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9eb93f394d28) has no exports 00000020:00000080:3.0:1788483041.643995:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78ac0 00000020:00000080:3.0:1788483041.644000:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb921638800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788483041.644727:0:12949:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788483041.644733:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788483041.644738:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788483041.644745:0:12949:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483041.644748:0:12949:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788483041.645169:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb921638800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788483041.645455:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483041.645468:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788483041.645476:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad789e0 00000020:00000080:3.0:1788483041.645486:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb9056f4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788483041.648398:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788483041.648428:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483041.648442:0:12949:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788483041.648448:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9eb93f648000) has no exports 00000020:00000080:3.0:1788483041.648460:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad789d9 00000020:00000080:3.0:1788483041.648469:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb908620800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788483041.649126:0:12949:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788483041.649133:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788483041.649140:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788483041.649149:0:12949:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788483041.649153:0:12949:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788483041.649196:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483041.649204:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788483041.649383:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483041.649411:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788483041.649415:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb93727f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788483041.649419:0:12949:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93727f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788483041.649426:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788483041.649685:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78890 00000020:00000080:3.0:1788483041.649692:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb92ec41000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788483041.649697:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788483041.649700:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483041.649704:0:12949:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788483041.649707:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9eb92ec54d28) has no exports 00000020:00000080:3.0:1788483041.649729:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483041.649732:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788483041.649734:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78897 00000020:00000080:3.0:1788483041.649737:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb92ec43800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788483041.649746:0:12949:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb9070c3000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788483041.649750:0:12949:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb9070c3000 3 00000020:01000004:3.0:1788483041.649753:0:12949:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eb9070c3000 from lustre-MDT0000 00000020:00000080:3.0:1788483041.649845:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483041.649849:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788483041.649852:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb93727c000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788483041.649854:0:12949:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93727c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788483041.649860:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788483041.649950:0:12949:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788483041.649954:0:12949:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788483041.649957:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788483041.649960:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483041.649962:0:12949:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788483041.649968:0:12949:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9eb92088a000 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788483041.649973:0:12949:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9eb903030000) has exports, disconnecting them 00000020:00080000:3.0:1788483041.649978:0:12949:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9eb92088a000), last request at 1788482803 00000020:00000080:3.0:1788483041.649991:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78835 00000020:00010000:3.0:1788483041.649995:0:12949:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9eb92088a000: total 4 00000100:00080000:3.0:1788483041.650004:0:12949:0:(import.c:65:import_set_state_nolock()) ffff9eb920888000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788483041.650045:0:12949:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eb92088a000): rc 0 00000020:00080000:3.0:1788483041.650106:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9eb903030000) has no exports 00000100:00100000:3.0:1788483041.650368:0:5800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9eb903186e00:5800] 0 exiting: rc = 1 00000020:00000080:2.0:1788483041.650603:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb92163a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788483041.650611:0:8:0:(genops.c:885:class_export_put()) final put ffff9eb92f7a7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788483041.650613:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92f7a7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788483041.650626:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788483041.650675:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb9056f4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788483041.650680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb908620800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788483041.650684:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb908622000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788483041.650688:0:8:0:(genops.c:885:class_export_put()) final put ffff9eb908624800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788483041.650690:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb908624800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788483041.650693:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788483041.650777:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92ec41000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788483041.650781:0:8:0:(genops.c:885:class_export_put()) final put ffff9eb937278000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788483041.650783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb937278000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788483041.650786:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788483041.651153:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92ec43800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788483041.651222:0:8489:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9eb92088a000: total 0 00010000:00010000:0.0:1788483041.651299:0:8489:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9eb92088a000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788483041.651335:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900030600/0x42820277aad78b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78b4c expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483041.651366:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f626a00/0x42820277aad78b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78b3e expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483041.651376:0:5802:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9eb903186200:5802] 2 exiting: rc = 0 00010000:00010000:0.0:1788483041.651378:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f780a00/0x42820277aad78b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78b68 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483041.651387:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492400/0x42820277aad78b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78b5a expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483041.651400:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb901492200/0x42820277aad78d7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78d75 expref: 5 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483041.651409:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb907368c00/0x42820277aad78d8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78d83 expref: 4 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483041.651425:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900031400/0x42820277aad78b99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78b92 expref: 3 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483041.651439:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb900030200/0x42820277aad7894d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x42820277aad78946 expref: 2 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483041.651449:0:8489:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9eb92088a000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788483041.651463:0:8489:0:(genops.c:885:class_export_put()) final put ffff9eb92088a000/7000a7a2-87a6-45e3-bd66-fc7b8b17ee30 00000100:00100000:2.0:1788483041.651468:0:5801:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9eb903186a00:5801] 1 exiting: rc = 0 00010000:00010000:0.0:1788483041.651480:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483041.651482:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483041.651484:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788483041.651490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92088a000/7000a7a2-87a6-45e3-bd66-fc7b8b17ee30 for MGS 00000020:00000080:0.0:1788483041.651531:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb920888000 for MGS 00000100:00100000:3.0:1788483041.651710:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651720:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651728:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651741:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651747:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651755:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651761:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651842:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651852:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651858:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651865:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651871:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651876:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651947:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651953:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651959:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651965:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651970:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651976:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651982:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651987:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651993:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.651999:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652021:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652027:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652034:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652039:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652045:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652113:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652121:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652137:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652144:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652149:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652156:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652163:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652169:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652175:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652180:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652185:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652190:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652196:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652200:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652205:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652210:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652214:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652219:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652224:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652229:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652242:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652354:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652361:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652367:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652371:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652376:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652382:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652387:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652392:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652401:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652754:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652762:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652829:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652837:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652842:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483041.652849:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788483041.653731:0:12949:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788483041.653744:0:12949:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788483041.657372:0:12949:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eb9186ff060 - data ffff9eb931889af8/ffff9eb93febcc00 00000020:01000000:3.0:1788483041.658142:0:12949:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eb906612c00 - data ffff9eb9318045e8/ffff9eb91d0d7800 00000020:00000080:3.0:1788483041.659593:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78819 00000020:00000080:3.0:1788483041.659603:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb918378800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788483041.659652:0:12949:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb9070c3000 from MGS, refs=2 00000020:01000004:3.0:1788483041.659656:0:12949:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb9070c3000 2 00000020:01000004:3.0:1788483041.659659:0:12949:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eb9070c3000 from MGS 00000020:00000080:3.0:1788483041.659685:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788483041.659693:0:12949:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788483041.659695:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb91837f000/MGS 00000020:00000080:3.0:1788483041.659698:0:12949:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb91837f000/MGS for MGS 00000020:01000000:3.0:1788483041.659705:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788483041.659773:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788483041.659777:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788483041.659783:0:12949:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788483041.659791:0:12949:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9eb937ed5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788483041.659797:0:12949:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9eb920883370) has exports, disconnecting them 00000020:00080000:3.0:1788483041.659802:0:12949:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9eb937ed5800), last request at 1788482804 00000020:00000080:3.0:1788483041.659806:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad788e4 00000020:00080000:3.0:1788483041.659816:0:12949:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eb937ed5800): rc 0 00000020:00000080:3.0:1788483041.659821:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb937ed5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788483041.659857:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb918378800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788483041.661572:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb937ed5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788483041.662389:0:12949:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788483041.662395:0:12949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788483041.662399:0:12949:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788483041.662571:0:12949:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788483041.662598:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb937ed3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788483041.662750:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483041.662759:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788483041.662764:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb92f762800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788483041.662768:0:12949:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92f762800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788483041.662773:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788483041.662829:0:12949:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb9070c3000 1 00000020:00000080:2.0:1788483041.662834:0:12949:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad7880b 00000020:00000080:2.0:1788483041.662841:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb91837d800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788483041.662847:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788483041.662853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb91837d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788483041.662860:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483041.662864:0:12949:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788483041.662867:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9eb903034d28) has no exports 00000020:00000080:0.0:1788483041.694683:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483041.694713:0:12949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788483041.694720:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb91837a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788483041.694725:0:12949:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb91837a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788483041.694732:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788483041.694880:0:12949:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eb9070c2000 00000020:01000000:0.0:1788483041.694907:0:12949:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788483041.694910:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483041.694915:0:12949:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788483041.694922:0:12949:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9eb903033370) has no exports 00000100:00100000:0.0:1788483041.695027:0:5809:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9eb9293b5c00:5809] 2 exiting: rc = 0 00000100:00100000:2.0:1788483041.695088:0:6958:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9eb905725600:6958] 3 exiting: rc = 0 00000100:00100000:0.0:1788483041.695132:0:5806:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9eb903103800:5806] 0 exiting: rc = 1 00000100:00100000:1.0:1788483041.695372:0:5807:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9eb903f71e00:5807] 1 exiting: rc = 0 00000100:00100000:0.0:1788483041.695431:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695442:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695449:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695455:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695462:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695481:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695490:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695497:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695503:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695508:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695516:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695524:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695529:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695535:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695540:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695546:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695553:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695560:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695567:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695574:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695579:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695586:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695592:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695611:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695617:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695624:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695631:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695637:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695643:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695655:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695661:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695667:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695672:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695678:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695683:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695689:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695694:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695699:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695705:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695712:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695718:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695723:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695729:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695737:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695743:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695749:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695754:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695760:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695765:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695771:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695777:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695784:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695790:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695796:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695802:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695809:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695814:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695820:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695835:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695841:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695849:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695855:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695862:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.695875:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.699745:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9eb9293b4e00:5810] 0 exiting: rc = 1 00000100:00100000:0.0:1788483041.699745:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9eb906360a00:5811] 1 exiting: rc = 0 00000100:00100000:1.0:1788483041.700069:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700080:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700087:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700095:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700103:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700111:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700118:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700123:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700128:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700133:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700139:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700143:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700149:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700153:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700157:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700161:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700165:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700168:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700174:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700177:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700181:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700184:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700188:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700191:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700195:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700198:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700202:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700205:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700208:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700211:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700215:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700240:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700280:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700287:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700293:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700299:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700305:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700310:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700314:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700318:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700322:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700326:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700329:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700333:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700336:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700340:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700343:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700346:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700349:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700352:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700356:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700360:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700364:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700368:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700373:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700377:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700380:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700383:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700386:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700390:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700393:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700396:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700400:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.700405:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.700854:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9eb903102200:5813] 1 exiting: rc = 0 00000100:00100000:3.0:1788483041.700857:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9eb903102a00:5812] 0 exiting: rc = 1 00000100:00100000:2.0:1788483041.700952:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.700961:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.700968:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.700975:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.700985:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701003:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701019:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701026:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701041:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701048:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701060:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701065:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701071:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701076:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701081:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701086:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701091:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701095:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701099:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701106:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701117:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701122:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701127:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701132:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701136:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701141:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701146:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701153:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701159:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701164:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701169:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701175:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701189:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701195:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701200:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701205:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701210:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701214:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701219:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701223:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701238:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701243:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701327:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701335:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701356:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701364:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701369:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701375:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701381:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701387:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701393:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701400:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701688:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701697:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701701:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701706:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701722:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701729:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701734:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701740:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701745:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701750:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701755:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.701761:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712319:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9eb9116bba00:5814] 0 exiting: rc = 1 00000100:00100000:0.0:1788483041.712553:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9eb9116bae00:5815] 1 exiting: rc = 0 00000100:00100000:1.0:1788483041.712612:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712636:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712642:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712649:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712655:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712661:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712665:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712669:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712672:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712676:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712679:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712683:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712686:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712690:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712693:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712697:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712700:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712703:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712707:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712710:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712713:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712716:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712719:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712721:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712724:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712729:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712732:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712735:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712739:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712742:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712745:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712748:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712752:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712755:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712759:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712762:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712771:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712774:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712778:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712782:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712786:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712789:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712792:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712796:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712799:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712802:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712804:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712807:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712811:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712814:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712816:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712820:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712822:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712825:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712828:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712831:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712833:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712836:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712839:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712842:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712845:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712847:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712851:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.712854:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.713353:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9eb9116bac00:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1788483041.713640:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9eb9116bb400:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1788483041.713711:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713717:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713722:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713729:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713735:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713739:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713743:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713753:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713758:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713761:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713765:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713769:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713773:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713777:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713781:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713784:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713787:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713790:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713793:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713797:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713800:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713803:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713807:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713809:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713812:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713815:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713818:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713821:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713823:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713826:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713829:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713832:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713835:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713838:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713841:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713844:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713847:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713850:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713853:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713856:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713860:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713863:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713871:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713874:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713877:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713881:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713883:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713886:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713889:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713892:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713895:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713899:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713901:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713905:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713908:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713910:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713913:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713916:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713919:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713922:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713926:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713928:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713931:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483041.713935:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714441:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9eb9116ba400:5819] 1 exiting: rc = 0 00000100:00100000:2.0:1788483041.714615:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9eb9116bb600:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1788483041.714700:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714707:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714713:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714719:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714725:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714729:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714733:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714737:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714741:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714745:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714750:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714752:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714756:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714759:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714763:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714765:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714769:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714772:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714775:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714779:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714782:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714785:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714788:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714804:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714807:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714811:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714815:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714818:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714822:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714825:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714828:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714831:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714834:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714837:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714840:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714843:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714847:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714850:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714853:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714856:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714860:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714863:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714866:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714869:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714872:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714877:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714880:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714883:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714887:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714890:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714892:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714896:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714898:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714901:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714904:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714907:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714911:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714914:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714921:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714925:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714928:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714931:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714934:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.714937:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788483041.715686:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9eb9116bbc00:5821] 1 exiting: rc = 0 00000100:00100000:3.0:1788483041.715877:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9eb9116bb200:5822] 2 exiting: rc = 0 00000100:00100000:1.0:1788483041.716179:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9eb9116ba200:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1788483041.716234:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716243:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716317:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716326:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716333:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716340:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716345:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716351:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716357:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716363:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716369:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716374:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716380:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716386:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716393:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716400:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716406:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716413:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716420:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716427:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716434:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716453:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716461:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716468:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716475:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716482:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716487:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716493:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716499:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716522:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716527:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716534:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716541:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716548:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716554:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716560:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716568:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716573:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716580:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716585:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716592:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716597:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716603:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716609:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716616:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716637:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716644:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716650:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716656:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716662:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716668:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716675:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716682:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716688:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716695:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716701:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716708:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716714:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716719:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716724:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716731:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716737:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716744:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788483041.716750:0:12949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788483041.722036:0:12949:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483041.722113:0:12949:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788483041.722124:0:12949:0:(genops.c:885:class_export_put()) final put ffff9eb9087f5000/MDS_uuid 00000020:00000080:0.0:1788483041.722129:0:12949:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb9087f5000/MDS_uuid for MDS 00000020:01000000:0.0:1788483041.722136:0:12949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788483041.722691:0:12949:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788483042.162806:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483042.236129:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072423680:0@lo:400:kworker.0 00000400:00000100:3.0:1788483042.236198:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360072423680 offset 0 length 224: 4 00000100:00100000:3.0:1788483042.236666:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483042.236675:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072423552:0@lo:400:kworker.0 00000400:00000100:3.0:1788483042.236703:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360072423552 offset 0 length 224: 4 00000100:00100000:3.0:1788483042.236753:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072423808:0@lo:400:kworker.0 00000400:00000100:3.0:1788483042.236774:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360072423808 offset 0 length 224: 4 00000001:00100000:1.0:1788483042.348967:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788483042.348978:0:7620:0:(genops.c:885:class_export_put()) final put ffff9eb9056f1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788483042.349049:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb9056f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788483042.349107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb9056f2000 for lustre-OST0001 00010000:00010000:0.0:1788483043.192069:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483044.216717:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788483044.853895:0:13101:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788483044.875474:0:13101:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788483044.875527:0:13101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483044.875543:0:13101:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483044.875551:0:13101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483044.875559:0:13101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483044.875588:0:13101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788483044.875594:0:13101:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788483044.875620:0:13101:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483044.875635:0:13101:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eb903113800 x1875360072423680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483044.875652:0:13101:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788483044.875690:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072423680:0@lo:400:kworker.0 00000100:00080000:3.0:1788483044.875722:0:13101:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788483044.875746:0:13101:0:(import.c:65:import_set_state_nolock()) ffff9eb93f38a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788483044.875846:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483044.875855:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483044.875864:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900031a00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788483044.875869:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483044.875899:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483044.875907:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483044.875913:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483044.875916:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788483044.875919:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788483044.875949:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483044.875968:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483044.875997:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483044.876004:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb900031a00/0x42820277aad78b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x42820277aad78b61 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483044.876017:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483044.876019:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483044.876021:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483044.876030:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483044.876043:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072424064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483044.876126:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483044.876899:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3276:1875360072423936:0@lo:39:umount.0 00000400:00000100:0.0:1788483044.876937:0:3276:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360072423936 offset 0 length 224: 4 00000100:00100000:0.0:1788483044.876993:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072424064 00000100:00100000:0.0:1788483044.877000:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072424064 00000100:00100000:0.0:1788483044.877048:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788483044.877056:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9243b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3279:x1875360072424064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788483044.877063:0:5793:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788483044 with bad export cookie 4792395666466244661 00000100:00100000:0.0:1788483044.886521:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9243b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3279:x1875360072424064:12345-0@lo:103:ldlm_bl.0 Request processed in 9455us (10386us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788483044.886538:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788483044.886803:0:3279:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788483044.886810:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9eb920888800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788483044.886814:0:3279:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788483044.895906:0:3279:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.106@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788483044.895929:0:3279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788483044.895939:0:3279:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eb903111f80 x1875360072423552/t0(0) o400->MGC192.168.201.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788483058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483044.896039:0:3279:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eb92eb45c00 x1875360072424064/t0(0) o103->MGC192.168.201.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788483060 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788483044.896049:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788483044.896052:0:3279:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788483044.896054:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788483044.896057:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9eb920888800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788483044.896062:0:3279:0:(import.c:510:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 120 00000100:00080000:2.0:1788483044.896071:0:3279:0:(import.c:624:import_select_connection()) MGC192.168.201.106@tcp: import ffff9eb920888800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788483044.896101:0:3279:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb92eb44380 x1875360072424192/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788483044.896140:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3279:1875360072424064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483044.896210:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3276:1875360072424192:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788483044.896295:0:3276:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360072424192 offset 0 length 520: 4 00000100:00100000:3.0:1788483044.898700:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3278:1875360072423552:0@lo:400:kworker.0 00010000:00010000:0.0:1788483045.234931:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483046.262270:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483047.282552:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788483047.348581:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483047.348593:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788483047.348848:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072424320:0@lo:400:kworker.0 00000400:00000100:2.0:1788483047.348942:0:3277:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360072424320 offset 0 length 224: 4 00010000:00010000:0.0:1788483048.306518:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483049.334412:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483050.354517:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788483050.354529:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788483050.354668:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3278:1875360072424448:0@lo:400:kworker.0 00000400:00000100:3.0:1788483050.354730:0:3278:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360072424448 offset 0 length 224: 4 00010000:00010000:2.0:1788483050.354935:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483051.379389:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483052.407020:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483053.428683:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483054.002384:0:3276:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483044/real 1788483044] req@ffff9eb92eb44380 x1875360072424192/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788483054 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483054.002423:0:3276:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eb92eb44380 x1875360072424192/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788483054 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483054.002433:0:3276:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483044/real 1788483044] req@ffff9eb903113800 x1875360072423936/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483054 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483054.002445:0:3276:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eb903113800 x1875360072423936/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483054 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788483054.002458:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb920888800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483054.002485:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788483054.002489:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3276:1875360072424192:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788483054.002495:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb93f38a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788483054.002553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788483054.002559:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788483054.002563:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eb920888800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788483054.002566:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3276:1875360072423936:0@lo:39:umount.0 00000100:00080000:1.0:1788483054.002570:0:37:0:(import.c:510:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 362 00000100:00080000:1.0:1788483054.002593:0:37:0:(import.c:589:import_select_connection()) MGC192.168.201.106@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483054.002621:0:37:0:(import.c:624:import_select_connection()) MGC192.168.201.106@tcp: import ffff9eb920888800 using connection 192.168.201.106@tcp/0@lo 00000100:00080000:3.0:1788483054.002724:0:13101:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483054.002729:0:13101:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788483054.002744:0:13101:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788483054.006551:0:13101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483054.006576:0:13101:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483054.006583:0:13101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483054.006591:0:13101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483054.006701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9217e6d80 x1875360072424576/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788483054.006862:0:13101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483054.006873:0:13101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483054.006880:0:13101:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483054.006886:0:13101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483054.006893:0:13101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483054.006904:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072424704:0@lo:400:kworker.0 00010000:00010000:3.0:1788483054.006929:0:13101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788483054.006936:0:13101:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788483054.006960:0:13101:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788483054.006965:0:13101:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788483054.006971:0:13101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000400:00000100:1.0:1788483054.006972:0:3279:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360072424704 offset 0 length 224: 4 00000020:00000080:3.0:1788483054.006979:0:13101:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788483054.006987:0:13101:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9eb93f390000) has no exports 00000020:00080000:3.0:1788483054.007016:0:13101:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9eb93f390000) has no exports 00010000:00010000:0.0:1788483054.008215:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483054.008226:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.008237:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900031000 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788483054.008242:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.008279:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483054.008288:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483054.008314:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788483054.008316:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788483054.008319:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788483054.008337:0:5797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eb920888800 00000100:00100000:1.0:1788483054.008342:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3276:1875360072424576:0@lo:250:kworker.0 00010000:00010000:0.0:1788483054.008343:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.008356:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb900031000/0x42820277aad78b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78b6f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.008371:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483054.008375:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.008382:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626000 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:0.0:1788483054.008385:0:5797:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:1.0:1788483054.008393:0:3276:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875360072424576 offset 0 length 520: 4 00010000:00010000:0.0:1788483054.008395:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788483054.008404:0:5797:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483054.008410:0:5797:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788483054.008413:0:5797:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788483054.008415:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788483054.008422:0:5797:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eb920888800 00010000:00010000:0.0:1788483054.008425:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.008439:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f626000/0x42820277aad78d83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78d8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483054.008448:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483054.008450:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483054.008452:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483054.008459:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788483054.012286:0:13101:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eb937049600 - data ffff9eb933111870/ffff9eb937e9fc00 00000020:01000000:2.0:1788483054.012592:0:13101:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eb90573d6c0 - data ffff9eb931b41ca8/ffff9eb93f335c00 00100000:10000000:2.0:1788483054.025566:0:13101:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788483054.061482:0:13101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78969 00000020:00000080:1.0:1788483054.061492:0:13101:0:(genops.c:885:class_export_put()) final put ffff9eb92f764800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788483054.061507:0:13101:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb906309000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788483054.061510:0:13101:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb906309000 2 00000020:01000004:1.0:1788483054.061513:0:13101:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eb906309000 from lustre-OST0000 00000020:00000080:0.0:1788483054.061620:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92f764800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788483054.061670:0:13101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483054.061684:0:13101:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788483054.061688:0:13101:0:(genops.c:885:class_export_put()) final put ffff9eb9293e6800/lustre-OST0000_UUID 00000020:00000080:1.0:1788483054.061690:0:13101:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb9293e6800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788483054.061695:0:13101:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788483054.061740:0:13101:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788483054.061744:0:13101:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788483054.061748:0:13101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483054.061753:0:13101:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788483054.061759:0:13101:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9eb93f388800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788483054.061764:0:13101:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9eb93f64cd28) has exports, disconnecting them 00000020:00080000:1.0:1788483054.061769:0:13101:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9eb93f388800), last request at 1788482821 00000020:00000080:1.0:1788483054.061773:0:13101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78993 00000020:00080000:1.0:1788483054.061783:0:13101:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eb93f388800): rc 0 00000020:00000080:1.0:1788483054.061811:0:13101:0:(genops.c:885:class_export_put()) final put ffff9eb93f388800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788483054.062744:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93f388800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788483054.063364:0:13101:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788483054.063369:0:13101:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788483054.063374:0:13101:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788483054.063381:0:13101:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788483054.063831:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb93f38a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788483054.063908:0:13101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483054.063917:0:13101:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788483054.063923:0:13101:0:(genops.c:885:class_export_put()) final put ffff9eb93f389800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788483054.063926:0:13101:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93f389800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788483054.063931:0:13101:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788483054.063984:0:13101:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb906309000 1 00000020:00000080:1.0:1788483054.063992:0:13101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78923 00000020:00000080:1.0:1788483054.063998:0:13101:0:(genops.c:885:class_export_put()) final put ffff9eb92f7a1800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788483054.064110:0:13101:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788483054.064114:0:13101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483054.064119:0:13101:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788483054.064122:0:13101:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9eb9208819b8) has no exports 00000020:00000080:0.0:1788483054.064541:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92f7a1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788483054.086440:0:13101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788483054.086458:0:13101:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788483054.086463:0:13101:0:(genops.c:885:class_export_put()) final put ffff9eb90630f000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788483054.086468:0:13101:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb90630f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788483054.086481:0:13101:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788483054.086625:0:13101:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eb90630b000 00000020:02000400:0.0:1788483054.086673:0:13101:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788483054.450728:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483055.477415:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483056.501812:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788483057.095219:0:13252:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788483057.104120:0:13252:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788483057.104207:0:13252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483057.104225:0:13252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483057.104234:0:13252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483057.104276:0:13252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483057.104291:0:13252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788483057.104296:0:13252:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788483057.104323:0:13252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483057.104335:0:13252:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eb903111500 x1875360072423808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483057.104353:0:13252:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eb9217e7480 x1875360072424320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483063 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483057.104372:0:13252:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eb801ff7800 x1875360072424448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483066 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483057.104386:0:13252:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eb9217e6680 x1875360072424704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483070 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483057.104395:0:13252:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788483057.104401:0:13252:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788483057.104424:0:13252:0:(import.c:65:import_set_state_nolock()) ffff9eb9293e1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788483057.104464:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3278:1875360072424448:0@lo:400:kworker.0 00010000:00010000:2.0:1788483057.104494:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483057.104501:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483057.104508:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072424704:0@lo:400:kworker.0 00010000:00010000:2.0:1788483057.104510:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb900030a00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788483057.104514:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483057.104516:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3279:1875360072423808:0@lo:400:kworker.0 00010000:00010000:2.0:1788483057.104528:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483057.104536:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483057.104542:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483057.104544:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788483057.104547:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788483057.104561:0:5796:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eb920888800 00010000:00010000:2.0:1788483057.104565:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.104571:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb900030a00/0x42820277aad78b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78b45 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483057.104586:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483057.104587:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483057.104589:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483057.104797:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072424320:0@lo:400:kworker.0 00000100:00100000:1.0:1788483057.104833:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3276:1875360072424832:0@lo:39:umount.0 00000400:00000100:1.0:1788483057.104885:0:3276:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875360072424832 offset 0 length 224: 4 00010000:00010000:1.0:1788483057.522466:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483058.549010:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788483059.123355:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788483059.123367:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788483059.570500:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483060.595499:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483061.618730:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483062.642551:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483063.666425:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788483064.242445:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788483064.242456:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788483064.692712:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483065.714726:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483066.740094:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483067.314719:0:3276:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483057/real 1788483057] req@ffff9eb801ff4000 x1875360072424832/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483067.314929:0:3276:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eb801ff4000 x1875360072424832/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788483067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788483067.314986:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb9293e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788483067.315007:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3276:1875360072424832:0@lo:39:umount.0 00000100:00080000:0.0:1788483067.315655:0:13252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788483067.315665:0:13252:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788483067.315676:0:13252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788483067.317615:0:13252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483067.317635:0:13252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483067.317661:0:13252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483067.317668:0:13252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483067.317704:0:13252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483067.317712:0:13252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483067.317720:0:13252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483067.317727:0:13252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483067.317734:0:13252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483067.317754:0:13252:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788483067.317758:0:13252:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788483067.317787:0:13252:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788483067.317792:0:13252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788483067.317797:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788483067.317803:0:13252:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788483067.317808:0:13252:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9eb93f393370) has no exports 00000020:00080000:0.0:1788483067.317839:0:13252:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9eb93f393370) has no exports 00010000:00010000:2.0:1788483067.318105:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483067.318120:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.318133:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780e00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788483067.318138:0:8489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.318172:0:8489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483067.318500:0:8489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483067.318509:0:8489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483067.318512:0:8489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788483067.318516:0:8489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788483067.318540:0:8489:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eb920888800 00010000:00010000:2.0:1788483067.318545:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.318554:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f780e00/0x42820277aad78b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78b53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.318594:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483067.318599:0:8489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.318605:0:8489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781600 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788483067.318608:0:8489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.318615:0:8489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483067.318622:0:8489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483067.318640:0:8489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788483067.318642:0:8489:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788483067.318644:0:8489:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788483067.318653:0:8489:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eb920888800 00010000:00010000:2.0:1788483067.318655:0:8489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.318662:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f781600/0x42820277aad78d75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78d7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.318680:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483067.318682:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483067.318684:0:8489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483067.318706:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788483067.320797:0:13252:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eb937049ae0 - data ffff9eb931868870/ffff9eb937e9f000 00000020:01000000:0.0:1788483067.321062:0:13252:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9eb90664da20 - data ffff9eb9333bae58/ffff9eb801a36000 00100000:10000000:0.0:1788483067.332719:0:13252:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788483067.398339:0:13252:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78a34 00000020:00000080:2.0:1788483067.398352:0:13252:0:(genops.c:885:class_export_put()) final put ffff9eb939a46000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788483067.398371:0:13252:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb93f7bc000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788483067.398375:0:13252:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb93f7bc000 2 00000020:01000004:2.0:1788483067.398378:0:13252:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9eb93f7bc000 from lustre-OST0001 00000020:00000080:2.0:1788483067.398407:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483067.398418:0:13252:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788483067.398422:0:13252:0:(genops.c:885:class_export_put()) final put ffff9eb903fb7800/lustre-OST0001_UUID 00000020:00000080:2.0:1788483067.398425:0:13252:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb903fb7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788483067.398434:0:13252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788483067.398596:0:13252:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30->MGS 00010000:00010000:2.0:1788483067.399840:0:13252:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad7894d expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483067.399861:0:13252:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad7894d expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483067.400087:0:13252:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788483067.400090:0:13252:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788483067.400094:0:13252:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788483067.400113:0:13252:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eb920888800 00010000:00010000:2.0:1788483067.400117:0:13252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2600/0x42820277aad78946 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad7894d expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483067.400139:0:13252:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x42820277aad78b99 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483067.400146:0:13252:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x42820277aad78b99 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483067.400151:0:13252:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788483067.400153:0:13252:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788483067.400154:0:13252:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788483067.400175:0:13252:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9eb920888800 00010000:00010000:2.0:1788483067.400178:0:13252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f626e00/0x42820277aad78b92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x42820277aad78b99 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788483067.400196:0:13252:0:(import.c:65:import_set_state_nolock()) ffff9eb920888800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788483067.400200:0:13252:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788483067.400202:0:13252:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788483067.400203:0:13252:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788483067.400207:0:13252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788483067.400218:0:13252:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9eb9217e6d80 x1875360072424576/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788483069 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788483067.400243:0:13252:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788483067.400246:0:13252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:1.0:1788483067.400336:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb939a46000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788483067.400820:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7000a7a2-87a6-45e3-bd66-fc7b8b17ee30:3276:1875360072424576:0@lo:250:kworker.0 10000000:01000000:2.0:1788483067.401965:0:13252:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788483067.402003:0:13252:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78827 00000020:00000080:2.0:1788483067.402013:0:13252:0:(genops.c:885:class_export_put()) final put ffff9eb9087f4000/7000a7a2-87a6-45e3-bd66-fc7b8b17ee30 00000020:01000000:2.0:1788483067.402074:0:13252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.106@tcp (flags='') 00000020:00000080:2.0:1788483067.402082:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483067.402090:0:13252:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788483067.402094:0:13252:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9eb920884d28) has no exports 10000000:01000000:3.0:1788483067.402175:0:5804:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788483067.403099:0:13252:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.106@tcp: client import never connected 00000100:00080000:2.0:1788483067.403105:0:13252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788483067.403109:0:13252:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788483067.403112:0:13252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788483067.403115:0:13252:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788483067.404862:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb9087f4000/7000a7a2-87a6-45e3-bd66-fc7b8b17ee30 for MGC192.168.201.106@tcp 00000020:00000080:2.0:1788483067.408302:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788483067.408319:0:13252:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.106@tcp (uuid 7000a7a2-87a6-45e3-bd66-fc7b8b17ee30) 00000020:01000000:2.0:1788483067.408326:0:13252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788483067.408334:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788483067.408339:0:13252:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788483067.408347:0:13252:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9eb92ec45000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788483067.408354:0:13252:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9eb93f3919b8) has exports, disconnecting them 00000020:00080000:2.0:1788483067.408360:0:13252:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9eb92ec45000), last request at 1788482841 00000020:00000080:2.0:1788483067.408366:0:13252:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78a5e 00000020:00080000:2.0:1788483067.408387:0:13252:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9eb92ec45000): rc 0 00000020:00000080:2.0:1788483067.408392:0:13252:0:(genops.c:885:class_export_put()) final put ffff9eb92ec45000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788483067.409474:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb920888800 for MGC192.168.201.106@tcp 00000020:00000080:1.0:1788483067.409486:0:37:0:(genops.c:885:class_export_put()) final put ffff9eb9057cc800/7000a7a2-87a6-45e3-bd66-fc7b8b17ee30 00000020:00000080:1.0:1788483067.409489:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb9057cc800/7000a7a2-87a6-45e3-bd66-fc7b8b17ee30 for MGC192.168.201.106@tcp 00000020:01000000:1.0:1788483067.409496:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.106@tcp (7000a7a2-87a6-45e3-bd66-fc7b8b17ee30) 00000020:00000080:1.0:1788483067.409780:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92ec45000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788483067.453394:0:13252:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788483067.453406:0:13252:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788483067.453411:0:13252:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788483067.453456:0:13252:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788483067.453574:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788483067.453739:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9eb9293e1800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788483067.454200:0:8489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788483067.454361:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788483067.454499:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9eb903fe9800:5792] 1 exiting: rc = 0 00000100:00100000:1.0:1788483067.454587:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9eb9082c2600:5791] 0 exiting: rc = 1 00000100:00100000:1.0:1788483067.454656:0:8488:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9eb92e6fe800:8488] 2 exiting: rc = 0 00000100:00100000:3.0:1788483067.454813:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.455246:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9eb918314800:5795] 2 exiting: rc = 0 00000100:00100000:1.0:1788483067.455342:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9eb903fe9c00:5793] 0 exiting: rc = 1 00000100:00100000:1.0:1788483067.455398:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9eb9243ac000:5794] 1 exiting: rc = 0 00000100:00100000:3.0:1788483067.456399:0:8490:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9eb93fe06000:8490] 3 exiting: rc = 0 00000100:00100000:1.0:1788483067.456601:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456622:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456630:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456636:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456642:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456648:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456654:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456661:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456667:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456685:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456691:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456696:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456702:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456707:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456713:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456718:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456725:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456731:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456736:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456741:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456747:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456752:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456758:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456763:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456769:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456775:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456780:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456796:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456803:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456809:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456815:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456820:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456827:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456833:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456839:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456845:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456851:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456857:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456863:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456868:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.456874:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457185:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457191:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457196:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457211:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457216:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457220:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457225:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457231:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457236:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457241:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457246:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457284:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457290:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457295:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457299:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457304:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457309:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457314:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457318:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457324:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457329:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457334:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.457340:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788483067.462468:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483067.462482:0:13252:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788483067.462489:0:13252:0:(genops.c:885:class_export_put()) final put ffff9eb93727e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788483067.462493:0:13252:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93727e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788483067.462499:0:13252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788483067.462551:0:13252:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb93f7bc000 1 00000020:00000080:1.0:1788483067.462557:0:13252:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x42820277aad78a03 00000020:00000080:1.0:1788483067.462577:0:13252:0:(genops.c:885:class_export_put()) final put ffff9eb93f7bc800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788483067.462594:0:13252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788483067.462599:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483067.462605:0:13252:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788483067.462608:0:13252:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9eb9030319b8) has no exports 00000020:00000080:3.0:1788483067.463179:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93f7bc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788483067.499515:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483067.499535:0:13252:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788483067.499556:0:13252:0:(genops.c:885:class_export_put()) final put ffff9eb93f7be000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788483067.499571:0:13252:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb93f7be000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788483067.499579:0:13252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788483067.499787:0:13252:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9eb93f7ba800 00000020:01000000:1.0:1788483067.499811:0:13252:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788483067.499816:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788483067.499821:0:13252:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788483067.499825:0:13252:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9eb92ec50000) has no exports 00000020:00000080:1.0:1788483067.499855:0:13252:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788483067.499862:0:13252:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788483067.499865:0:13252:0:(genops.c:885:class_export_put()) final put ffff9eb92f7a5000/OSS_uuid 00000020:00000080:1.0:1788483067.499867:0:13252:0:(genops.c:844:class_export_destroy()) destroying export ffff9eb92f7a5000/OSS_uuid for OSS 00000020:01000000:1.0:1788483067.499870:0:13252:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788483067.499970:0:5803:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788483067.500151:0:12045:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9eb91f180c00:12045] 3 exiting: rc = 0 00000100:00100000:3.0:1788483067.500676:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9eb905709800:6660] 0 exiting: rc = 1 00000100:00100000:3.0:1788483067.500741:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9eb918315e00:6663] 2 exiting: rc = 0 00000100:00100000:3.0:1788483067.500807:0:12501:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9eb939e0d400:12501] 4 exiting: rc = 0 00000100:00100000:2.0:1788483067.501349:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9eb905709e00:6662] 1 exiting: rc = 0 00000100:00100000:1.0:1788483067.501514:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.501524:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.501531:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.501538:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.501543:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.503545:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.503584:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.503591:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.503597:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.503603:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504000:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504007:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504013:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504018:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504023:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504028:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504033:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504039:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504044:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504071:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504076:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504083:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504088:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504093:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504099:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504104:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504110:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504114:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504120:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504126:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504132:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504137:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504143:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504148:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504154:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504158:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504163:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504168:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504174:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504180:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504187:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504192:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504198:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504203:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504210:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504215:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504220:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504226:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504231:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504236:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504242:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504247:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504279:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504284:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504296:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504302:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504310:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504315:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504321:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504326:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504331:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504336:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504341:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.504348:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483067.509037:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9eb90595ec00:6664] 0 exiting: rc = 1 00000100:00100000:3.0:1788483067.509319:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9eb936c94600:6665] 1 exiting: rc = 0 00000100:00100000:1.0:1788483067.510664:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510675:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510682:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510687:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510693:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510700:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510706:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510713:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510720:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510726:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510731:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510737:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510742:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510748:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510753:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510759:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510765:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510771:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510779:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510786:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510792:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510798:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510804:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510811:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510817:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510836:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510842:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510847:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510853:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510860:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510865:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510870:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510876:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510881:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510889:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510894:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510901:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510907:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510914:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510919:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510925:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510930:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510936:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510940:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510946:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510952:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510956:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510962:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510967:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510972:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510977:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510983:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510988:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510993:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.510998:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511003:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511009:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511015:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511020:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511026:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511038:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511043:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511050:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.511056:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.512099:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9eb936c94c00:6668] 2 exiting: rc = 0 00000100:00100000:1.0:1788483067.512352:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9eb936c95400:6667] 1 exiting: rc = 0 00000100:00100000:3.0:1788483067.513998:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9eb936c94000:6666] 0 exiting: rc = 1 00000100:00100000:1.0:1788483067.514061:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514069:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514074:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514080:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514086:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514110:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514117:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514123:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514128:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514134:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514138:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514144:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514149:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514155:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514161:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514166:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514171:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514176:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514183:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514188:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514195:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514200:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514205:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514209:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514214:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514219:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514224:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514229:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514235:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514291:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514298:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514304:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514310:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514316:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514322:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514329:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514338:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514344:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514351:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514357:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514364:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514370:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514377:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514382:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514388:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514394:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514399:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514405:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514411:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514417:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514424:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514429:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514435:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514443:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514451:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514458:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514480:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514486:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514492:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514497:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514503:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514509:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514515:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.514520:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.524436:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9eb936c96600:6670] 1 exiting: rc = 0 00000100:00100000:3.0:1788483067.524891:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9eb936c96800:6669] 0 exiting: rc = 1 00000100:00100000:1.0:1788483067.525414:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525421:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525427:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525433:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525438:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525443:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525448:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525454:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525459:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525464:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525470:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525475:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525480:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525485:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525490:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525495:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525500:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525506:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525512:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525517:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525522:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525527:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525532:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525537:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525543:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525549:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525555:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525572:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525579:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525584:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525591:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525596:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525602:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.525608:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526174:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526180:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526186:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526191:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526197:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526232:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526239:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526244:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526274:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526281:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526286:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526291:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526296:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526301:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526306:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526312:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526317:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526322:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526328:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526333:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526339:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526343:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526348:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526353:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526358:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526363:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526369:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526374:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526379:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.526390:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788483067.528618:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9eb93bc0da00:6671] 0 exiting: rc = 1 00000100:00100000:1.0:1788483067.529806:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9eb93bc0ce00:6672] 1 exiting: rc = 0 00000100:00100000:1.0:1788483067.530105:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530115:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530121:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530127:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530162:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530169:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530177:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530183:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530190:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530197:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530204:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530211:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530218:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530224:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530231:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530237:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530286:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530294:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530300:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530306:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530313:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530318:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530324:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530331:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530340:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530347:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530354:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530361:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530381:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530387:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530394:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530401:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530406:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530412:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530418:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530423:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530430:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530436:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530441:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530454:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530473:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530480:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530486:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530493:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530500:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530505:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530511:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530518:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530524:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530531:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530537:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.530544:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531625:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531643:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531651:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531657:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531666:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531673:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531680:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531687:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531695:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531701:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531709:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788483067.531715:0:13252:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788483067.553872:0:13252:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788483085.864719:0:13866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788483094.031078:0:14327:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788483094.031084:0:14327:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788483094.031207:0:14327:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eb92163b000 00000020:01000004:2.0:1788483094.031223:0:14327:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788483094.031231:0:14327:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788483094.031245:0:14327:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9eb9030319b8) 00000020:00000080:2.0:1788483094.031296:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788483094.049434:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788483094.051878:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788483094.052399:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788483094.052467:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 435: rc = 0 00100000:10000000:2.0:1788483094.052714:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 435: rc = 0 00100000:10000000:2.0:1788483094.052849:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 435: rc = 0 00100000:10000000:2.0:1788483094.052930:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 435: rc = 0 00100000:10000000:2.0:1788483094.053007:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 435: rc = 0 00100000:10000000:2.0:1788483094.053085:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 435: rc = 0 00100000:10000000:2.0:1788483094.053439:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 437: rc = 0 00100000:10000000:2.0:1788483094.054672:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 462: rc = 0 00100000:10000000:2.0:1788483094.054779:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 462: rc = 0 00100000:10000000:2.0:1788483094.055195:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 773: rc = 0 00100000:10000000:2.0:1788483094.055934:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788483094.056233:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 773: rc = 0 00100000:10000000:2.0:1788483094.056686:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788483094.056957:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788483094.057409:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 773: rc = 0 00100000:10000000:2.0:1788483094.057871:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:2.0:1788483094.058161:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788483094.058446:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788483094.058842:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1788483094.059136:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:3.0:1788483094.059863:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:3.0:1788483094.060487:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 541: rc = 0 00100000:10000000:3.0:1788483094.060913:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 541: rc = 0 00100000:10000000:3.0:1788483094.061187:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 541: rc = 0 00100000:10000000:3.0:1788483094.061782:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 541: rc = 0 00100000:10000000:3.0:1788483094.062115:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 541: rc = 0 00100000:10000000:3.0:1788483094.062464:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 541: rc = 0 00100000:10000000:3.0:1788483094.062862:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 541: rc = 0 00100000:10000000:3.0:1788483094.063123:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 541: rc = 0 00100000:10000000:3.0:1788483094.063466:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 541: rc = 0 00100000:10000000:3.0:1788483094.063877:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 541: rc = 0 00100000:10000000:3.0:1788483094.064152:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 541: rc = 0 00100000:10000000:3.0:1788483094.064492:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 541: rc = 0 00100000:10000000:3.0:1788483094.064881:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 541: rc = 0 00100000:10000000:3.0:1788483094.065174:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 541: rc = 0 00100000:10000000:3.0:1788483094.065580:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 541: rc = 0 00100000:10000000:3.0:1788483094.065916:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 541: rc = 0 00100000:10000000:3.0:1788483094.066183:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 541: rc = 0 00100000:10000000:3.0:1788483094.066671:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 541: rc = 0 00100000:10000000:3.0:1788483094.066931:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 541: rc = 0 00100000:10000000:3.0:1788483094.067201:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 541: rc = 0 00100000:10000000:3.0:1788483094.067667:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 541: rc = 0 00100000:10000000:3.0:1788483094.067941:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 541: rc = 0 00100000:10000000:3.0:1788483094.068204:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 541: rc = 0 00100000:10000000:3.0:1788483094.068518:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 541: rc = 0 00100000:10000000:3.0:1788483094.068780:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 541: rc = 0 00100000:10000000:3.0:1788483094.069064:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 541: rc = 0 00100000:10000000:3.0:1788483094.069382:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 541: rc = 0 00100000:10000000:3.0:1788483094.070026:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 541: rc = 0 00100000:10000000:3.0:1788483094.070419:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 541: rc = 0 00100000:10000000:3.0:1788483094.070826:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 541: rc = 0 00100000:10000000:3.0:1788483094.071087:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 541: rc = 0 00100000:10000000:3.0:1788483094.071462:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 541: rc = 0 00100000:10000000:3.0:1788483094.071984:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 778: rc = 0 00100000:10000000:3.0:1788483094.072661:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788483094.072836:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 530: rc = 0 00100000:10000000:3.0:1788483094.073031:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788483094.073097:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 530: rc = 0 00100000:10000000:3.0:1788483094.073408:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788483094.073474:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 530: rc = 0 00100000:10000000:3.0:1788483094.073965:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788483094.074032:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 463: rc = 0 00100000:10000000:3.0:1788483094.074238:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788483094.074334:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 463: rc = 0 00100000:10000000:3.0:1788483094.074653:0:14327:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788483094.074726:0:14327:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 463: rc = 0 00000020:00000080:3.0:1788483094.074986:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788483094.074994:0:14327:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788483094.075006:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad79b28 00000020:01000004:3.0:1788483094.075016:0:14327:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788483094.075021:0:14327:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788483094.075026:0:14327:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eb92163b000 from MGS 00000020:01000004:3.0:1788483094.075030:0:14327:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788483094.075041:0:14327:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9eb93f64b370) 00000020:00000080:3.0:1788483094.075050:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788483094.075119:0:14327:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb92163b000 from MGS, refs=2 00080000:01000000:3.0:1788483094.075125:0:14327:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788483094.075130:0:14327:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad79b36 00000100:00100000:3.0:1788483094.075220:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788483094.075453:0:14327:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788483094.075459:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788483094.076178:0:14327:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788483094.076186:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788483094.077210:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483094.077672:0:14327:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788483094.077679:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788483094.078313:0:14327:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788483094.078321:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788483094.078763:0:14327:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788483094.078768:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788483094.079880:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483094.079885:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483094.079887:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483094.080162:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483094.080165:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483094.080167:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483094.081006:0:14327:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788483094.085216:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788483094.096809:0:14327:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788483094.096828:0:14327:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788483094.096831:0:14327:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788483094.098690:0:14336:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788483094.100981:0:14327:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788483094.101101:0:14327:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788483094.102526:0:14327:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788483094.102858:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483094.103044:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788483094.103051:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788483094.114025:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788483094.114043:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788483094.115425:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788483094.115436:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788483094.116211:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788483094.116233:0:14327:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.106@tcp' 00000020:01000004:0.0:1788483094.116235:0:14327:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788483094.116403:0:14327:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.106@tcp (typ=mgc) 00000020:00000080:0.0:1788483094.116416:0:14327:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.106@tcp (ffff9eb93f3919b8) 00000020:00000080:0.0:1788483094.116431:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788483094.116671:0:14327:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb929345800@MGC192.168.201.106@tcp: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1788483094.116829:0:14327:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.106@tcp-0 is initialized 00000040:01000000:0.0:1788483094.116836:0:14327:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788483094.117245:0:14342:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788483094.117352:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.106@tcp (uuid 34a2d1d6-061f-4613-bc6f-7f9dfae33666) 00000020:00000080:0.0:1788483094.117370:0:14327:0:(genops.c:1385:class_connect()) connect: client 34a2d1d6-061f-4613-bc6f-7f9dfae33666, cookie 0x42820277aad79b44 00000100:00080000:0.0:1788483094.117380:0:14327:0:(import.c:510:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788483094.117386:0:14327:0:(import.c:624:import_select_connection()) MGC192.168.201.106@tcp: import ffff9eb929345800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788483094.117420:0:14327:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb801ff7100 x1875360072424960/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788483094.117449:0:14327:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 34a2d1d6-061f-4613-bc6f-7f9dfae33666->MGS 00000020:01000004:0.0:1788483094.117466:0:14327:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788483094.117471:0:14327:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788483094.117480:0:14327:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9eb93f393370) 00000020:00000080:0.0:1788483094.117488:0:14327:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788483094.117614:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3276:1875360072424960:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788483094.117695:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.117802:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072424960 00000100:00100000:2.0:1788483094.117812:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072424960 00000100:00100000:2.0:1788483094.117857:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483094.117865:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3276:x1875360072424960:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788483094.117894:0:14338:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 34a2d1d6-061f-4613-bc6f-7f9dfae33666@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:2.0:1788483094.117915:0:14338:0:(genops.c:1385:class_connect()) connect: client 34a2d1d6-061f-4613-bc6f-7f9dfae33666, cookie 0x42820277aad79b52 00000100:00080000:2.0:1788483094.118037:0:14338:0:(import.c:65:import_set_state_nolock()) ffff9eb921638800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483094.118091:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+5:3276:x1875360072424960:12345-0@lo:250:mount.lustre.0 Request processed in 224us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483094.118100:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483094.118158:0:3276:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788483094.118168:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.106@tcp: connect to target with instance 0 00000100:00080000:2.0:1788483094.118176:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788483094.118181:0:3276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788483094.118184:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb929345800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788483094.118187:0:3276:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788483094.118197:0:3276:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788483094.118202:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3276:1875360072424960:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1788483094.118437:0:14341:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788483094.143485:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483094.143717:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788483094.143724:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788483094.158651:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788483094.158667:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788483094.160232:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788483094.160242:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788483094.161061:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483094.161448:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788483094.161453:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788483094.161848:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788483094.161854:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788483094.266687:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483094.267064:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788483094.267073:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788483094.268808:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788483094.268819:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788483094.269527:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788483094.269699:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788483094.269705:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788483094.277907:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788483094.277924:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788483094.278586:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483094.278770:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788483094.278775:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788483094.279207:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788483094.279213:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788483094.280240:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483094.280416:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788483094.280421:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788483094.280872:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788483094.280878:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788483094.350457:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483094.351874:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788483094.351883:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788483094.364425:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788483094.364444:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788483094.375295:0:14327:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788483094.375318:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788483094.381153:0:14327:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788483094.381180:0:14327:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788483094.381188:0:14327:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788483094.381370:0:14327:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788483094.381405:0:14327:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788483094.381510:0:14327:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788483094.381512:0:14327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483094.381514:0:14327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483094.381515:0:14327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483094.381517:0:14327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483094.381518:0:14327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483094.381519:0:14327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483094.381521:0:14327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483094.381522:0:14327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483094.381524:0:14327:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483094.381527:0:14327:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788483094.381529:0:14327:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788483094.381530:0:14327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483094.381532:0:14327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483094.381532:0:14327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483094.381533:0:14327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483094.381542:0:14327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483094.381543:0:14327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483094.381544:0:14327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483094.381545:0:14327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483094.381545:0:14327:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788483094.381586:0:14327:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788483094.381607:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483094.381680:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.381800:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.381912:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072425088 00000100:00100000:0.0:1788483094.381920:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072425088 00000100:00100000:0.0:1788483094.381962:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483094.381971:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+5:14327:x1875360072425088:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788483094.382018:0:14340:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788483094.382021:0:14340:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788483094.382024:0:14340:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788483094.383153:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788483094.383668:0:14340:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788483094.385345:0:14362:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788483094.385352:0:14362:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788483094.385356:0:14362:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788483094.385389:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788483094.385978:0:14340:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788483094.385989:0:14340:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788483094.409185:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+5:14327:x1875360072425088:12345-0@lo:253:mount.lustre.0 Request processed in 27200us (27490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483094.409219:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483094.409369:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788483094.409389:0:14327:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788483094.409392:0:14327:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788483094.409395:0:14327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483094.409396:0:14327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483094.409397:0:14327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483094.409398:0:14327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483094.409400:0:14327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483094.409401:0:14327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483094.409402:0:14327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483094.409404:0:14327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483094.409405:0:14327:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788483094.409432:0:14327:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eb92163b000 from lustre-MDT0000 10000000:01000000:3.0:1788483094.409457:0:14327:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788483094.409459:0:14327:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788483094.409463:0:14327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9eb93f3919b8 10000000:01000000:3.0:1788483094.409468:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788483094.409476:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9eb93f3919b8 from 1 10000000:01000000:3.0:1788483094.409479:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788483094.409521:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.409531:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.409553:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483094.409572:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483094.409610:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.409653:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.409914:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072425216 00000100:00100000:0.0:1788483094.409921:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072425216 00000100:00100000:0.0:1788483094.409953:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788483094.409962:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+5:14327:x1875360072425216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483094.409974:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483094.409989:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907369600/0x42820277aad79b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79b59 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.410011:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907369600/0x42820277aad79b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79b59 expref: 6 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.410021:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907369600/0x42820277aad79b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79b59 expref: 6 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.410041:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369600, rc 0) 00000100:00100000:0.0:1788483094.410078:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+6:14327:x1875360072425216:12345-0@lo:101:mount.lustre.0 Request processed in 118us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.410084:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483094.411034:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483094.411052:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.411063:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483094.411158:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483094.411206:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.411277:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.411428:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072425344 00000100:00100000:0.0:1788483094.411435:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072425344 00000100:00100000:0.0:1788483094.411481:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483094.411491:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+6:14327:x1875360072425344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483094.411756:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+6:14327:x1875360072425344:12345-0@lo:501:mount.lustre.0 Request processed in 265us (548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788483094.411764:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483094.411825:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425344:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788483094.411852:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788483094.411873:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.411882:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483094.411892:0:14327:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eb92163b000 10000000:01000000:2.0:1788483094.411897:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788483094.411902:0:14327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9eb92163b000 10000000:01000000:2.0:1788483094.411904:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788483094.411907:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9eb92163b000 from 1 10000000:01000000:2.0:1788483094.411910:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788483094.411954:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb910c66800/0x42820277aad79b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.411962:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb910c66800/0x42820277aad79b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.412069:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb910c66800/0x42820277aad79b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483094.412085:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483094.412138:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.412243:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773180 going to sleep for 11 seconds 00000100:00100000:3.0:1788483094.412282:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072425472 00000100:00100000:3.0:1788483094.412287:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072425472 00000100:00100000:3.0:1788483094.412396:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483094.412406:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+6:14327:x1875360072425472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483094.412424:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483094.412439:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe15400/0x42820277aad79b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79b67 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.412456:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe15400/0x42820277aad79b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79b67 expref: 7 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.412477:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe15400/0x42820277aad79b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79b67 expref: 7 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.412486:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15400, rc 0) 00000100:00100000:3.0:1788483094.412524:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+7:14327:x1875360072425472:12345-0@lo:101:mount.lustre.0 Request processed in 120us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483094.412530:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788483094.412683:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483094.412703:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb910c66800/0x42820277aad79b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b6e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.412712:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb910c66800/0x42820277aad79b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79b6e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483094.412724:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788483094.412735:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb910c66800/0x42820277aad79b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b6e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.412742:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb910c66800/0x42820277aad79b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b6e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483094.412748:0:14327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788483094.412751:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788483094.412756:0:14327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9eb92163b000 10000000:01000000:2.0:1788483094.412759:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788483094.412762:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788483094.412764:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788483094.412779:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb910c67e00/0x42820277aad79b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.412785:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb910c67e00/0x42820277aad79b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.412790:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb910c67e00/0x42820277aad79b75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483094.412799:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483094.412828:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.412852:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773180 going to sleep for 11 seconds 00000100:00100000:3.0:1788483094.412859:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072425600 00000100:00100000:3.0:1788483094.412864:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072425600 00000100:00100000:3.0:1788483094.412903:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483094.412911:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+7:14327:x1875360072425600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483094.412919:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483094.412928:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe14200/0x42820277aad79b7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79b75 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.412941:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe14200/0x42820277aad79b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79b75 expref: 8 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.412950:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe14200/0x42820277aad79b7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79b75 expref: 8 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.412956:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14200, rc 0) 00000100:00100000:3.0:1788483094.412993:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+8:14327:x1875360072425600:12345-0@lo:101:mount.lustre.0 Request processed in 83us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483094.412998:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483094.413060:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483094.413071:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb910c67e00/0x42820277aad79b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b7c expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.413078:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb910c67e00/0x42820277aad79b75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79b7c expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483094.413133:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483094.413159:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483094.413211:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9033e3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788483094.413245:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072425728 00000100:00100000:3.0:1788483094.413763:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072425728 00000100:00100000:0.0:1788483094.413900:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483094.413907:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+8:14327:x1875360072425728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483094.414317:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+9:14327:x1875360072425728:12345-0@lo:501:mount.lustre.0 Request processed in 409us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.414494:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483094.414813:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483094.414859:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483094.414896:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.414935:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.414941:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072425856 00000100:00100000:0.0:1788483094.414947:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072425856 00000100:00100000:0.0:1788483094.415015:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483094.415024:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+9:14327:x1875360072425856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483094.415467:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+9:14327:x1875360072425856:12345-0@lo:503:mount.lustre.0 Request processed in 443us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.415475:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483094.415719:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072425856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483094.417786:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14363:1875360072425984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483094.417885:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.417938:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f7736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.418014:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072425984 00000100:00100000:0.0:1788483094.418023:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072425984 00000100:00100000:0.0:1788483094.418070:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483094.418081:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+9:14363:x1875360072425984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483094.418489:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+9:14363:x1875360072425984:12345-0@lo:502:llog_process_th.0 Request processed in 407us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.418514:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788483094.419784:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14363:1875360072425984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788483094.419842:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483094.419857:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.419860:0:14363:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788483094.419867:0:14363:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788483094.419870:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483094.419888:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9eb903033370) 00000020:00000080:2.0:1788483094.419910:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788483094.419916:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788483094.419999:0:14363:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788483094.420007:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad79b8a 00000020:00000080:2.0:1788483094.420335:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788483094.420339:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483094.420343:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.420345:0:14363:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788483094.420348:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483094.420351:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.420361:0:14363:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788483094.420366:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483094.420373:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9eb903034d28) 00000020:00000080:2.0:1788483094.420382:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788483094.420386:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788483094.420388:0:14363:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788483094.420391:0:14363:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788483094.420396:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788483094.420437:0:14363:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb92163b000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788483094.420450:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9eb903030000) 00000020:00000080:2.0:1788483094.420459:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788483094.420542:0:14363:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788483094.420551:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad79b9f 00000020:00000080:2.0:1788483094.420640:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788483094.420647:0:14363:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788483094.420651:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x42820277aad79ba6 00080000:01000000:2.0:1788483094.420657:0:14363:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788483094.420661:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad79bad 00010000:00010000:1.0:1788483094.483570:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788483094.484018:0:14363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1788483094.484217:0:14363:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788483094.486221:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9eb93b4eb370) 00000020:00000080:1.0:1788483094.486242:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788483094.486334:0:14363:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788483094.486341:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad79bbb 00000020:00000080:3.0:1788483094.489177:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788483094.497170:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x42820277aad79bc2 00000020:00000080:2.0:1788483094.497590:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788483094.497602:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483094.497608:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.497611:0:14363:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788483094.497614:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483094.497622:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.497624:0:14363:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788483094.497628:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788483094.497671:0:14363:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788483094.497683:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483094.497686:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.497688:0:14363:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788483094.497691:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788483094.497693:0:14363:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1788483094.497695:0:14363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483094.497702:0:14363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483094.497704:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788483094.497707:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.497708:0:14363:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788483094.497711:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788483094.497714:0:14363:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788483094.497718:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.497719:0:14363:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788483094.497722:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788483094.497727:0:14363:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:2.0:1788483094.497748:0:14363:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788483094.497750:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483094.497771:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9eb93b5199b8) 00000020:00000080:2.0:1788483094.497784:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788483094.497788:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788483094.497826:0:14363:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788483094.497830:0:14363:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788483094.497833:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad79bd0 00010000:00080000:2.0:1788483094.497861:0:14363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb92087e000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1788483094.498072:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788483094.498475:0:14363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788483094.498515:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788483094.499420:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483094.499462:0:14363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788483094.499536:0:14363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788483094.500724:0:14367:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788483094.500730:0:14367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788483094.501562:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788483094.501574:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788483094.501611:0:14363:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788483094.501636:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad79bd7 00000100:00080000:2.0:1788483094.501651:0:14363:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483094.501658:0:14363:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eb92087e000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788483094.501698:0:14363:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb92eb45c00 x1875360072426112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483094.501780:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072426112:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788483094.501843:0:3276:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360072426112 offset 0 length 520: 4 00000100:00080000:2.0:1788483094.501920:0:14363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788483094.501990:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483094.501995:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.501998:0:14363:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788483094.502000:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788483094.502003:0:14363:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788483094.502005:0:14363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483094.502007:0:14363:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483094.502008:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788483094.502010:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.502012:0:14363:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788483094.502015:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788483094.502020:0:14363:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788483094.502023:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.502024:0:14363:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788483094.502026:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788483094.502030:0:14363:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:2.0:1788483094.502052:0:14363:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788483094.502054:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483094.502066:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9eb93b51cd28) 00000020:00000080:2.0:1788483094.502079:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788483094.502084:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788483094.502147:0:14363:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788483094.502153:0:14363:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788483094.502158:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x42820277aad79be5 00010000:00080000:2.0:1788483094.502186:0:14363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb902d3e000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1788483094.502421:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788483094.502621:0:14363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788483094.502643:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788483094.503343:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483094.503423:0:14363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788483094.503542:0:14363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788483094.504276:0:14369:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788483094.504281:0:14369:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788483094.505018:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788483094.505031:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788483094.505069:0:14363:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788483094.505090:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad79bec 00000100:00080000:2.0:1788483094.505109:0:14363:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483094.505116:0:14363:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eb902d3e000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788483094.505166:0:14363:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb92eb44380 x1875360072426240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483094.505193:0:14363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788483094.505274:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483094.505278:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.505280:0:14363:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788483094.505283:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483094.505287:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.505288:0:14363:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788483094.505291:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788483094.505293:0:14363:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788483094.505295:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483094.505297:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.505298:0:14363:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788483094.505301:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483094.505303:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.505304:0:14363:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788483094.505307:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788483094.505335:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14363:1875360072426368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483094.505416:0:14363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.505451:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.505883:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072426368 00000100:00100000:0.0:1788483094.505890:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072426368 00000100:00100000:0.0:1788483094.505935:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788483094.505944:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+9:14363:x1875360072426368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788483094.506168:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+9:14363:x1875360072426368:12345-0@lo:502:llog_process_th.0 Request processed in 223us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.506175:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788483094.506215:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072426240:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788483094.506243:0:3276:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360072426240 offset 0 length 520: 4 00000100:00100000:2.0:1788483094.506370:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14363:1875360072426368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788483094.506396:0:14363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483094.506406:0:14363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483094.506408:0:14363:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788483094.506411:0:14363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788483094.506556:0:14327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788483094.506575:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788483094.506596:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb910c67e00/0x42820277aad79b75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b7c expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.506606:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb910c67e00/0x42820277aad79b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b7c expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483094.506614:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eb92163b000 from 1 10000000:01000000:0.0:1788483094.506617:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788483094.506646:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.506654:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.506662:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483094.506676:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072426496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788483094.506704:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483094.506775:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb906340300 going to sleep for 11 seconds 00000100:00100000:1.0:1788483094.507066:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072426496 00000100:00100000:1.0:1788483094.507073:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072426496 00000100:00100000:1.0:1788483094.507152:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788483094.507163:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+9:14327:x1875360072426496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483094.507174:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483094.507191:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79bf3 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483094.507231:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79bf3 expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483094.507243:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79bf3 expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483094.507458:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f626a00, rc 0) 00000100:00100000:1.0:1788483094.507501:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+10:14327:x1875360072426496:12345-0@lo:101:mount.lustre.0 Request processed in 341us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483094.507508:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483094.507604:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072426496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483094.507620:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.507629:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483094.508160:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072426624:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788483094.508207:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.508420:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.508511:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072426624 00000100:00100000:0.0:1788483094.508520:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072426624 00000100:00100000:0.0:1788483094.508550:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483094.508558:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+10:14327:x1875360072426624:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788483094.508574:0:14340:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788483094.508582:0:14340:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788483094.508660:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+10:14327:x1875360072426624:12345-0@lo:256:mount.lustre.0 Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.508668:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788483094.508747:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072426624:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788483094.509367:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788483094.509390:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.509402:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483094.509411:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb92163b000 from 1 10000000:01000000:3.0:1788483094.509414:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483094.509451:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.509458:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.510957:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483094.510997:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072426752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483094.511090:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.511162:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.511548:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072426752 00000100:00100000:0.0:1788483094.511558:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072426752 00000100:00100000:0.0:1788483094.511601:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483094.511611:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+10:14327:x1875360072426752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483094.511625:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483094.511643:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79c01 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.511667:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79c01 expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.511677:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c01 expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.511685:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368c00, rc 0) 00000100:00100000:0.0:1788483094.511730:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14327:x1875360072426752:12345-0@lo:101:mount.lustre.0 Request processed in 121us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.511737:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788483094.511990:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072426752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483094.512007:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.512015:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483094.512084:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072426880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483094.512123:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.512156:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbe780 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.512201:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072426880 00000100:00100000:0.0:1788483094.512206:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072426880 00000100:00100000:0.0:1788483094.512422:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483094.512429:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14327:x1875360072426880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483094.512869:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14327:x1875360072426880:12345-0@lo:501:mount.lustre.0 Request processed in 440us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.512877:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788483094.512961:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072426880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483094.512997:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072427008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483094.513036:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.513493:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbe780 going to sleep for 11 seconds 00000100:00100000:2.0:1788483094.513540:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072427008 00000100:00100000:2.0:1788483094.513548:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072427008 00000100:00100000:2.0:1788483094.513581:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483094.513590:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14327:x1875360072427008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483094.513757:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14327:x1875360072427008:12345-0@lo:503:mount.lustre.0 Request processed in 168us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483094.513764:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788483094.513845:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072427008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483094.514458:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14371:1875360072427136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483094.514503:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.514570:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483094.514609:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072427136 00000100:00100000:2.0:1788483094.514615:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072427136 00000100:00100000:2.0:1788483094.514688:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483094.514697:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14371:x1875360072427136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483094.514918:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14371:x1875360072427136:12345-0@lo:502:llog_process_th.0 Request processed in 223us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483094.514926:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788483094.514990:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14371:1875360072427136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483094.515016:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483094.515026:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483094.515029:0:14371:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788483094.515036:0:14371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb92163b000 00000020:00000080:3.0:1788483094.515039:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483094.515048:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483094.515050:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483094.515052:0:14371:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788483094.515054:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483094.515056:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483094.515058:0:14371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788483094.515061:0:14371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb92163b000 00000020:00000080:3.0:1788483094.515063:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483094.515156:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483094.515159:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483094.515160:0:14371:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788483094.515163:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483094.515165:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483094.515166:0:14371:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483094.515169:0:14371:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eb92163b000 00000020:00000080:3.0:1788483094.515171:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788483094.515205:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14371:1875360072427264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483094.515238:0:14371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.519335:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788483094.519423:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072427264 00000100:00100000:1.0:1788483094.519438:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072427264 00000100:00100000:1.0:1788483094.519499:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788483094.519511:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14371:x1875360072427264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788483094.519779:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14371:x1875360072427264:12345-0@lo:502:llog_process_th.0 Request processed in 268us (4539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483094.519787:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788483094.520576:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14371:1875360072427264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788483094.520612:0:14371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483094.520621:0:14371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483094.520624:0:14371:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788483094.520628:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788483094.520769:0:14327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788483094.520787:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483094.520804:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.520815:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483094.520860:0:14327:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788483094.520863:0:14327:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eb92163b000 10000000:01000000:0.0:1788483094.520866:0:14327:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eb92163b000 10000000:01000000:0.0:1788483094.520870:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788483094.520876:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb92163b000 from 1 10000000:01000000:0.0:1788483094.520879:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788483094.520910:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907368600/0x42820277aad79c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.520918:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb907368600/0x42820277aad79c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.520928:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb907368600/0x42820277aad79c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483094.520950:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072427392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788483094.520999:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483094.521160:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9180889c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483094.528509:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072427392 00000100:00100000:2.0:1788483094.528525:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072427392 00000100:00100000:3.0:1788483094.529240:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788483094.529279:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14327:x1875360072427392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483094.529299:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483094.529323:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe15600/0x42820277aad79c16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79c0f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.529352:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe15600/0x42820277aad79c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79c0f expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.529363:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe15600/0x42820277aad79c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c0f expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.529372:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15600, rc 0) 00000100:00100000:3.0:1788483094.529490:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14327:x1875360072427392:12345-0@lo:101:mount.lustre.0 Request processed in 215us (8490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483094.529498:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788483094.531312:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072427392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483094.531344:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb907368600/0x42820277aad79c0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c16 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.531357:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb907368600/0x42820277aad79c0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79c16 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483094.531452:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072427520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483094.531516:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.531567:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788483094.534431:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072427520 00000100:00100000:0.0:1788483094.534451:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072427520 00000100:00100000:0.0:1788483094.534522:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788483094.534533:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14327:x1875360072427520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483094.534859:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14327:x1875360072427520:12345-0@lo:501:mount.lustre.0 Request processed in 328us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.534867:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788483094.535196:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072427520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483094.535275:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072427648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483094.535332:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.535373:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1788483094.535389:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072427648 00000100:00100000:3.0:1788483094.535394:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072427648 00000100:00100000:3.0:1788483094.535418:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788483094.535425:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14327:x1875360072427648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483094.535583:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14327:x1875360072427648:12345-0@lo:503:mount.lustre.0 Request processed in 158us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483094.535591:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788483094.535631:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072427648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483094.537361:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14376:1875360072427776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483094.537447:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.537495:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773480 going to sleep for 11 seconds 00000100:00100000:3.0:1788483094.537559:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072427776 00000100:00100000:3.0:1788483094.537566:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072427776 00000100:00100000:3.0:1788483094.537606:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788483094.537615:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14376:x1875360072427776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483094.537861:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14376:x1875360072427776:12345-0@lo:502:llog_process_th.0 Request processed in 246us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483094.537869:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788483094.537951:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14376:1875360072427776:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788483094.537998:0:14376:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788483094.538011:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9eb93b518000) 00000020:00000080:2.0:1788483094.538026:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788483094.538194:0:14376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb92163b000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788483094.538209:0:14376:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb92163b000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788483094.538212:0:14376:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb92163b000 4 00010000:00080000:2.0:1788483094.538274:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb93ff28000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1788483094.542973:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788483094.545451:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788483094.545491:0:14376:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788483094.545509:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x42820277aad79c24 00000100:00080000:2.0:1788483094.545521:0:14376:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788483094.545527:0:14376:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9eb93ff28000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788483094.545570:0:14376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb92eb45880 x1875360072427904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788483094.545599:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788483094.547807:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072427904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788483094.547893:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.551671:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072427904 00000100:00100000:2.0:1788483094.551691:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072427904 00000100:00100000:2.0:1788483094.551746:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483094.551755:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3276:x1875360072427904:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788483094.551858:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3276:x1875360072427904:12345-0@lo:38:llog_process_th.0 Request processed in 102us (3965us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788483094.551865:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483094.551927:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788483094.551937:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb93ff28000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788483094.551942:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788483094.551946:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072427904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788483094.556725:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14376:1875360072428032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788483094.556858:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.556917:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483094.558374:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072428032 00000100:00100000:3.0:1788483094.558396:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072428032 00000100:00100000:3.0:1788483094.558489:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788483094.558502:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14376:x1875360072428032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788483094.558891:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14376:x1875360072428032:12345-0@lo:502:llog_process_th.0 Request processed in 390us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483094.558900:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788483094.559000:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14376:1875360072428032:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788483094.559057:0:14376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788483094.559309:0:14327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788483094.559331:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788483094.559354:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907368600/0x42820277aad79c0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c16 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.559367:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb907368600/0x42820277aad79c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c16 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788483094.559438:0:14327:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788483094.559441:0:14327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483094.559443:0:14327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483094.559445:0:14327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483094.559446:0:14327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483094.559448:0:14327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483094.559449:0:14327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483094.559451:0:14327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483094.559453:0:14327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483094.559455:0:14327:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788483094.559462:0:14327:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788483094.559465:0:14327:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788483094.559467:0:14327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483094.559468:0:14327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483094.559470:0:14327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483094.559470:0:14327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483094.559471:0:14327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483094.559473:0:14327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483094.559474:0:14327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483094.559474:0:14327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483094.559476:0:14327:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788483094.559510:0:14327:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788483094.559537:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072428160:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788483094.559587:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483094.559623:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483094.562622:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072428160 00000100:00100000:2.0:1788483094.562655:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072428160 00000100:00100000:2.0:1788483094.562755:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788483094.562766:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14327:x1875360072428160:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483094.562800:0:14340:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788483094.562815:0:14340:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788483094.606193:0:14340:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788483094.606245:0:14340:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788483094.611675:0:14361:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788483094.611686:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788483094.611767:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.611786:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79bf3 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.611795:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.611847:0:14361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad79bf3 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.611862:0:14361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad79bf3 expref: 12 pid: 14338 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483094.611877:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14361:1875360072428288:0@lo:104: 00000100:00100000:2.0:1788483094.611945:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483094.611999:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f773180 going to sleep for 11 seconds 00000100:00100000:3.0:1788483094.612070:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072428288 00000100:00100000:3.0:1788483094.612091:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072428288 00000100:00100000:3.0:1788483094.612218:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788483094.612231:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:14361:x1875360072428288:12345-0@lo:104: 00010000:00010000:3.0:1788483094.612246:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483094.612455:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14361:1875360072428288:0@lo:104: 00010000:00010000:2.0:1788483094.612479:0:14361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483094.612580:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483094.612588:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:14361:x1875360072428288:12345-0@lo:104: Request processed in 359us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483094.612596:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788483094.613168:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483094.613186:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.613195:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369c00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788483094.613200:0:14334:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.613210:0:14334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483094.613218:0:14334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483094.613224:0:14334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788483094.613300:0:14334:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.613306:0:14334:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483094.613434:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.613442:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb907369c00/0x42820277aad79bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79bfa expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483094.615434:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3280:1875360072428416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483094.615533:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483094.615660:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072428416 00000100:00100000:0.0:1788483094.615670:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072428416 00010000:00010000:0.0:1788483094.615711:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79bf3 expref: 13 pid: 14338 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483094.615746:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483094.615757:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+13:3280:x1875360072428416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483094.615773:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483094.615779:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79bf3 expref: 13 pid: 14338 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615793:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad79bf3 expref: 13 pid: 14338 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615817:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f626a00/0x42820277aad79bfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad79bf3 expref: 13 pid: 14338 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615835:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615843:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788483094.615875:0:14330:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004189822s 00010000:00010000:0.0:1788483094.615880:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615887:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615893:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615899:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615905:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483094.615909:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615918:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615938:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483094.615951:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483094.615988:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:3280:x1875360072428416:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.615996:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483094.616038:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3280:1875360072428416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483094.616189:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483094.616192:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483094.616194:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483094.616245:0:14361:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.616306:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483094.616383:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb910c67600/0x42820277aad79c2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483094.616885:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14327:x1875360072428160:12345-0@lo:253:mount.lustre.0 Request processed in 54118us (57294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483094.616903:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788483094.616967:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14327:1875360072428160:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788483094.616979:0:14327:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788483094.616982:0:14327:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788483094.616985:0:14327:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788483094.616986:0:14327:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788483094.616987:0:14327:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788483094.616988:0:14327:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788483094.616990:0:14327:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788483094.616991:0:14327:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788483094.616993:0:14327:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788483094.616995:0:14327:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788483094.616996:0:14327:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788483094.617007:0:14327:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788483094.623142:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788483094.623556:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788483094.623857:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788483094.624010:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788483094.624598:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788483094.624820:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788483094.626003:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788483094.626181:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788483094.626921:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788483094.627169:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788483094.627779:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788483094.627944:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788483094.680593:0:14327:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788483094.681009:0:14327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788483094.681399:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788483094.681467:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483094.686144:0:14386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788483094.686222:0:14386:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788483094.686226:0:14386:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788483094.686659:0:14327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788483094.686856:0:14327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788483094.687210:0:14327:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788483094.687218:0:14327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:2.0:1788483094.687528:0:14385:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788483094.687533:0:14385:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1788483094.687848:0:14327:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483094.688944:0:14327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788483094.689729:0:14327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788483094.689775:0:14327:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788483094.692202:0:14327:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788483094.697173:0:14327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788483094.730002:0:14327:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788483094.730048:0:14327:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc16681c9f988 00100000:10000000:0.0:1788483094.730060:0:14327:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788483094.730990:0:14327:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788483094.731011:0:14327:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788483094.731030:0:14327:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788483094.731063:0:14327:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788483095.090566:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788483095.161461:0:14342:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788483095.161468:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eb92163b000 from 6 10000000:01000000:0.0:1788483095.161472:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788483095.161527:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483095.161539:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483095.161550:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483095.161580:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072428544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788483095.161634:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483095.161681:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f777000 going to sleep for 11 seconds 00000100:00100000:3.0:1788483095.161760:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072428544 00000100:00100000:3.0:1788483095.161766:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072428544 00000100:00100000:3.0:1788483095.161808:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788483095.161815:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14342:x1875360072428544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483095.161825:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483095.161836:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79c32 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483095.161852:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79c32 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483095.161859:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c32 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483095.161866:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14a00, rc 0) 00000100:00100000:3.0:1788483095.161900:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14342:x1875360072428544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483095.161904:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788483095.161978:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072428544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483095.161991:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483095.161997:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483095.162042:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072428672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788483095.162062:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483095.162095:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93f777000 going to sleep for 11 seconds 00000100:00100000:2.0:1788483095.162322:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072428672 00000100:00100000:2.0:1788483095.162327:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072428672 00000100:00100000:2.0:1788483095.162348:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788483095.162353:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14342:x1875360072428672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788483095.162363:0:14340:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788483095.162375:0:14340:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788483095.162377:0:14340:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788483095.162440:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14342:x1875360072428672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483095.162447:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788483095.162668:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072428672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788483095.162704:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788483095.162709:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483095.162715:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483095.604396:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788483096.115913:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483096.630739:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788483097.147100:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483098.162438:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483099.189528:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788483099.247404:0:14628:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788483099.572439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483099.572449:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483099.572452:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483099.572456:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788483099.572458:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788483099.572462:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788483099.572476:0:36:0:(import.c:65:import_set_state_nolock()) ffff9eb93ff28000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483099.572495:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9eb93ff28000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788483099.572530:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9217e4000 x1875360072428928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483099.572580:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788483099.572595:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072428800:0@lo:400:kworker.0 00000100:00100000:1.0:1788483099.572684:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483099.572765:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072428800 00000100:00100000:1.0:1788483099.572774:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072428800 00000100:00100000:1.0:1788483099.572823:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788483099.572834:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:3278:x1875360072428800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483099.573031:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:3278:x1875360072428800:12345-0@lo:400:kworker.0 Request processed in 198us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483099.573039:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788483099.573079:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072428928:0@lo:38:kworker.0 00000100:00100000:1.0:1788483099.573111:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483099.573161:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072428800:0@lo:400:kworker.0 00000100:00100000:3.0:1788483099.582596:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072428928 00000100:00100000:3.0:1788483099.582619:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072428928 00000100:00100000:3.0:1788483099.582724:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483099.582733:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3276:x1875360072428928:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788483099.582770:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:3.0:1788483099.582808:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x42820277aad79c40 00000004:00100000:3.0:1788483099.582827:0:14347:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788483099.582965:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9eb92088e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483099.583070:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875360072428928:12345-0@lo:38:kworker.0 Request processed in 336us (9957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483099.583077:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788483099.583154:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eb9217e4000 x1875360072428928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788483099.583176:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788483099.583185:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788483099.583191:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788483099.583194:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb93ff28000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788483099.583202:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875360072428928:0@lo:38:kworker.0 00010000:00010000:2.0:1788483100.211450:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483101.234359:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483102.261104:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788483102.589603:0:14779:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7bb820d0 20000000:00000080:2.0:1788483102.589621:0:14779:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eb93b7cf800 uarg=0000000000000000 20000000:01000000:2.0:1788483102.589656:0:14779:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788483102.589663:0:14779:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788483102.589667:0:14779:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788483102.595623:0:14780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788483102.595758:0:14779:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788483102.608952:0:14779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788483102.608998:0:14779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483102.609017:0:14779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c01 expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483102.609025:0:14779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483102.609064:0:14779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad79c01 expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483102.609080:0:14779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad79c01 expref: 11 pid: 14340 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483102.609094:0:14779:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14779:1875360072429056:0@lo:104: 00000100:00100000:2.0:1788483102.609163:0:14779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483102.609222:0:14779:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93a00d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483102.609420:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072429056 00000100:00100000:3.0:1788483102.609427:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072429056 00000100:00100000:3.0:1788483102.609479:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483102.609490:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:14779:x1875360072429056:12345-0@lo:104: 00010000:00010000:3.0:1788483102.609502:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609557:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483102.609562:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:14779:x1875360072429056:12345-0@lo:104: Request processed in 76us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483102.609568:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788483102.609588:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483102.609593:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609600:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14800 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:3.0:1788483102.609604:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609626:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483102.609633:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483102.609639:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483102.609665:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609670:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483102.609690:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609697:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14800/0x42820277aad79c01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c08 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609713:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483102.609714:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483102.609717:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483102.609734:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072429184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483102.609766:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483102.609824:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072429184 00000100:00100000:3.0:1788483102.609827:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072429184 00010000:00010000:3.0:1788483102.609843:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79c01 expref: 12 pid: 14340 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483102.609870:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483102.609876:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:3278:x1875360072429184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483102.609890:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483102.609895:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79c01 expref: 12 pid: 14340 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609904:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad79c01 expref: 12 pid: 14340 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609918:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609926:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609936:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609944:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609951:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609967:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609973:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483102.609977:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.609984:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.610002:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483102.610011:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483102.610035:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:3278:x1875360072429184:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483102.610042:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483102.610068:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072429184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483102.610227:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb907368c00/0x42820277aad79c08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad79c01 expref: 11 pid: 14340 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483102.610237:0:14779:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14779:1875360072429056:0@lo:104: 00010000:00010000:2.0:1788483102.610436:0:14779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483102.610480:0:14779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483102.610487:0:14779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483102.610494:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb910c66e00/0x42820277aad79c47 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483103.283466:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788483104.243600:0:14342:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483104.243608:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb92163b000 from 10 10000000:01000000:1.0:1788483104.243614:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483104.243673:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.243685:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483104.243696:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483104.243724:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072429312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483104.243800:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483104.243860:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034900 going to sleep for 11 seconds 00000100:00100000:3.0:1788483104.243925:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072429312 00000100:00100000:3.0:1788483104.243942:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072429312 00000100:00100000:3.0:1788483104.243997:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788483104.244006:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+11:14342:x1875360072429312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483104.244020:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483104.244033:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79c4e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483104.244055:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79c4e expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483104.244065:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c4e expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483104.244074:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14800, rc 0) 00000100:00100000:3.0:1788483104.244128:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14342:x1875360072429312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483104.244135:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788483104.244234:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072429312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483104.244272:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483104.244280:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483104.244338:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072429440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483104.244365:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483104.244402:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb918088b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788483104.244469:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072429440 00000100:00100000:2.0:1788483104.244473:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072429440 00000100:00100000:2.0:1788483104.244506:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788483104.244513:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14342:x1875360072429440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483104.244803:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14342:x1875360072429440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483104.244811:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483104.244949:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072429440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483104.244981:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072429568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483104.245029:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483104.245050:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb918088b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483104.245107:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072429568 00000100:00100000:3.0:1788483104.245118:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072429568 00000100:00100000:3.0:1788483104.245139:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788483104.245146:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14342:x1875360072429568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483104.245330:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:14342:x1875360072429568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483104.245337:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788483104.245412:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072429568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788483104.246744:0:14840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788483104.247052:0:14342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788483104.247078:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788483104.247091:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483104.247103:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483104.306475:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483104.694420:0:3276:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483094/real 1788483094] req@ffff9eb92eb44380 x1875360072426240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483104.694463:0:3276:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eb92eb44380 x1875360072426240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483104.694475:0:3276:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483094/real 1788483094] req@ffff9eb92eb45c00 x1875360072426112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483104.694487:0:3276:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eb92eb45c00 x1875360072426112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483104.694509:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483104.694526:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788483104.694530:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072426240:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788483104.694560:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb92087e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483104.694567:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788483104.694570:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072426112:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788483104.694712:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483104.694717:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788483104.694721:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eb92087e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483104.694727:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:1.0:1788483104.694733:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483104.694741:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eb92087e000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788483104.694786:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9217e4a80 x1875360072429696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483104.694815:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483104.694819:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788483104.694820:0:37:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483104.694823:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:1.0:1788483104.694834:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788483104.694838:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eb902d3e000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788483104.694851:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9217e7480 x1875360072429824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788483104.694950:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072429696:0@lo:8:kworker.0 00000400:00000100:3.0:1788483104.695012:0:3276:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360072429696 offset 0 length 520: 4 00000100:00100000:3.0:1788483104.695073:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072429824:0@lo:8:kworker.0 00000400:00000100:3.0:1788483104.695094:0:3276:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875360072429824 offset 0 length 520: 4 00000100:00100000:0.0:1788483104.695358:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072429952:0@lo:400:kworker.0 00000100:00100000:0.0:1788483104.695408:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483104.695503:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072429952 00000100:00100000:3.0:1788483104.695514:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072429952 00000100:00100000:3.0:1788483104.695578:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788483104.695588:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072429952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483104.695655:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072429952:12345-0@lo:400:kworker.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483104.695663:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788483104.695799:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eb9217e4000 x1875360072429952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483104.695814:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072429952:0@lo:400:kworker.0 00010000:00010000:2.0:1788483105.334972:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483106.354391:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788483106.870730:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788483107.378456:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788483107.991197:0:15027:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788483107.991200:0:15027:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788483107.991649:0:15027:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eb910c1a000 00000020:01000004:2.0:1788483107.991665:0:15027:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788483107.991677:0:15027:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788483107.991692:0:15027:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9eb93b51b370) 00000020:00000080:2.0:1788483107.991705:0:15027:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788483108.010157:0:15027:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788483108.011610:0:15027:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788483108.012590:0:15027:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788483108.013078:0:15027:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788483108.013451:0:15027:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788483108.014077:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 661: rc = 0 00100000:10000000:3.0:1788483108.014174:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 661: rc = 0 00100000:10000000:3.0:1788483108.014359:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 661: rc = 0 00100000:10000000:3.0:1788483108.014761:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 799: rc = 0 00100000:10000000:3.0:1788483108.015332:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 799: rc = 0 00100000:10000000:3.0:1788483108.015679:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 799: rc = 0 00100000:10000000:3.0:1788483108.016128:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 799: rc = 0 00100000:10000000:3.0:1788483108.016412:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 799: rc = 0 00100000:10000000:3.0:1788483108.017019:0:15027:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 799: rc = 0 00000020:00000080:3.0:1788483108.018291:0:15027:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788483108.018303:0:15027:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788483108.018384:0:15027:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42820277aad79c63 00000020:01000004:3.0:1788483108.018396:0:15027:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788483108.018420:0:15027:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788483108.018424:0:15027:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788483108.018431:0:15027:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788483108.018435:0:15027:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788483108.018458:0:15027:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9eb93f6499b8) 00000020:00000080:3.0:1788483108.018469:0:15027:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788483108.027784:0:15027:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788483108.028015:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788483108.028022:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788483108.032607:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788483108.032623:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788483108.042060:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788483108.042079:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788483108.044241:0:15027:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788483108.044928:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788483108.044935:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788483108.049524:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788483108.049538:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788483108.068815:0:15027:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483108.069064:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788483108.069069:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788483108.070090:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788483108.070102:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788483108.070982:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788483108.070991:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788483108.073733:0:15027:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788483108.074028:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788483108.074037:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788483108.080105:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788483108.080122:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788483108.125593:0:15027:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788483108.125861:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788483108.125880:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788483108.127857:0:15027:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788483108.127881:0:15027:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788483108.129129:0:15027:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788483108.129158:0:15027:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788483108.129166:0:15027:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788483108.140165:0:15027:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788483108.140211:0:15027:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788483108.140215:0:15027:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788483108.140217:0:15027:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788483108.140219:0:15027:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483108.140220:0:15027:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483108.140221:0:15027:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483108.140223:0:15027:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483108.140224:0:15027:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483108.140226:0:15027:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483108.140227:0:15027:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788483108.140231:0:15027:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788483108.140233:0:15027:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788483108.140234:0:15027:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788483108.140235:0:15027:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483108.140236:0:15027:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483108.140237:0:15027:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483108.140241:0:15027:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483108.140242:0:15027:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483108.140243:0:15027:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483108.140244:0:15027:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788483108.140338:0:15027:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788483108.140359:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430080:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788483108.140437:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.140594:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb92ec86480 going to sleep for 11 seconds 00000100:00100000:3.0:1788483108.140692:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072430080 00000100:00100000:3.0:1788483108.140702:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072430080 00000100:00100000:3.0:1788483108.140792:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788483108.140804:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:15027:x1875360072430080:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788483108.140856:0:14338:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788483108.140860:0:14338:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788483108.140875:0:14338:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788483108.148164:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:15027:x1875360072430080:12345-0@lo:253:mount.lustre.0 Request processed in 7350us (7715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.148203:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788483108.148461:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430080:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788483108.148479:0:15027:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788483108.148483:0:15027:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788483108.148485:0:15027:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788483108.148486:0:15027:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483108.148487:0:15027:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483108.148489:0:15027:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483108.148490:0:15027:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483108.148492:0:15027:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483108.148494:0:15027:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483108.148495:0:15027:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788483108.148517:0:15027:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eb910c1a000 from lustre-OST0000 10000000:01000000:1.0:1788483108.148554:0:15027:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788483108.148557:0:15027:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788483108.148568:0:15027:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eb93f3919b8 local copy 00010000:00010000:1.0:1788483108.148581:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483108.148900:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483108.149028:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.149186:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb92ec86300 going to sleep for 11 seconds 00000100:00100000:2.0:1788483108.149241:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072430208 00000100:00100000:2.0:1788483108.149318:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072430208 00000100:00100000:2.0:1788483108.149407:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788483108.149419:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:15027:x1875360072430208:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483108.149621:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:15027:x1875360072430208:12345-0@lo:501:mount.lustre.0 Request processed in 204us (591us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788483108.149629:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788483108.149716:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430208:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788483108.149735:0:15027:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788483108.149908:0:15027:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788483108.149918:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.149928:0:15027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483108.149964:0:15027:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eb910c1a000 10000000:01000000:0.0:1788483108.149969:0:15027:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788483108.149974:0:15027:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9eb93f3919b8 10000000:01000000:0.0:1788483108.149977:0:15027:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788483108.149980:0:15027:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9eb93f3919b8 from 1 10000000:01000000:0.0:1788483108.149984:0:15027:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788483108.150010:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369e00/0x42820277aad79c71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.150024:0:15027:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb907369e00/0x42820277aad79c71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.150035:0:15027:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb907369e00/0x42820277aad79c71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483108.150053:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430336:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788483108.150084:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483108.150367:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483108.150407:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072430336 00000100:00100000:1.0:1788483108.150414:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072430336 00000100:00100000:1.0:1788483108.150442:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788483108.150450:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+12:15027:x1875360072430336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483108.150468:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483108.150482:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f627200/0x42820277aad79c78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79c71 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.150505:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f627200/0x42820277aad79c78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79c71 expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.150514:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f627200/0x42820277aad79c78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c71 expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.150523:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f627200, rc 0) 00000100:00100000:1.0:1788483108.150562:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+13:15027:x1875360072430336:12345-0@lo:101:mount.lustre.0 Request processed in 113us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483108.150570:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788483108.150652:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483108.150665:0:15027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb907369e00/0x42820277aad79c71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c78 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.150674:0:15027:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb907369e00/0x42820277aad79c71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79c78 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483108.150692:0:15027:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788483108.150715:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369e00/0x42820277aad79c71 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c78 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.150723:0:15027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb907369e00/0x42820277aad79c71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c78 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788483108.150729:0:15027:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788483108.150733:0:15027:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788483108.150737:0:15027:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788483108.150739:0:15027:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788483108.150762:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369400/0x42820277aad79c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.150770:0:15027:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb907369400/0x42820277aad79c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.150778:0:15027:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb907369400/0x42820277aad79c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483108.150792:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788483108.150818:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483108.150830:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511000 going to sleep for 11 seconds 00000100:00100000:3.0:1788483108.150907:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072430464 00000100:00100000:3.0:1788483108.150911:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072430464 00000100:00100000:3.0:1788483108.150945:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788483108.150953:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+13:15027:x1875360072430464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483108.150959:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483108.150971:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe14e00/0x42820277aad79c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79c7f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.150986:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe14e00/0x42820277aad79c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79c7f expref: 14 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.150994:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe14e00/0x42820277aad79c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c7f expref: 14 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.151000:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14e00, rc 0) 00000100:00100000:3.0:1788483108.151040:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430464:12345-0@lo:101:mount.lustre.0 Request processed in 89us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.151047:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788483108.151243:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483108.151269:0:15027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb907369400/0x42820277aad79c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c86 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483108.151278:0:15027:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb907369400/0x42820277aad79c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79c86 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788483108.152055:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788483108.153014:0:15027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788483108.153670:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788483108.153722:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788483108.153757:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788483108.153802:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788483108.153837:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788483108.153905:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788483108.153984:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788483108.153992:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788483108.154164:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483108.154291:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483108.154350:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483108.155032:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072430592 00000100:00100000:1.0:1788483108.155043:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072430592 00000100:00100000:1.0:1788483108.155111:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788483108.155122:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483108.155553:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430592:12345-0@lo:501:mount.lustre.0 Request processed in 433us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483108.155560:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788483108.155809:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483108.155857:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483108.156064:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483108.156172:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483108.156222:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072430720 00000100:00100000:1.0:1788483108.156228:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072430720 00000100:00100000:2.0:1788483108.156356:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788483108.156369:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483108.156694:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430720:12345-0@lo:503:mount.lustre.0 Request processed in 328us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.156701:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788483108.156790:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788483108.157449:0:15027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788483108.157513:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483108.157556:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483108.157583:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788483108.157656:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072430848 00000100:00100000:1.0:1788483108.157662:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072430848 00000100:00100000:1.0:1788483108.157696:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788483108.157704:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483108.157891:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430848:12345-0@lo:502:mount.lustre.0 Request processed in 188us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483108.157905:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788483108.158026:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483108.158455:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788483108.158503:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788483108.158531:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788483108.158568:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788483108.158596:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788483108.158622:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788483108.158656:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788483108.158683:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788483108.158709:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788483108.158744:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788483108.158773:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788483108.158823:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788483108.158851:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483108.158909:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.159318:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072430976 00000100:00100000:1.0:1788483108.159325:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072430976 00000100:00100000:1.0:1788483108.159372:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788483108.159381:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483108.159734:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072430976:12345-0@lo:502:mount.lustre.0 Request processed in 353us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483108.159742:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788483108.159821:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb905511d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483108.159845:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072430976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483108.160035:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788483108.160053:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788483108.161717:0:15041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788483108.161730:0:15041:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788483108.161738:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483108.161741:0:15041:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788483108.161749:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788483108.161777:0:15041:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9eb937703370) 00000020:00000080:2.0:1788483108.161803:0:15041:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788483108.161811:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788483108.161914:0:15041:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb910c1a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788483108.161929:0:15041:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788483108.162016:0:15041:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x42820277aad79c94 00010000:00010000:2.0:1788483108.165501:0:15041:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788483108.166941:0:15041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788483108.170575:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788483108.172054:0:15041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788483108.172068:0:15041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483108.172074:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483108.172077:0:15041:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788483108.172080:0:15041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788483108.172083:0:15041:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788483108.172085:0:15041:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483108.172086:0:15041:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788483108.172088:0:15041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788483108.172091:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483108.172092:0:15041:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788483108.172095:0:15041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483108.172098:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483108.172099:0:15041:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788483108.172102:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788483108.172104:0:15041:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788483108.172106:0:15041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483108.172109:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483108.172110:0:15041:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788483108.172113:0:15041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788483108.172115:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483108.172117:0:15041:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788483108.172120:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788483108.172184:0:15041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788483108.172188:0:15041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788483108.172190:0:15041:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788483108.172193:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788483108.172377:0:15027:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788483108.172407:0:15027:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788483108.172431:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb907369400/0x42820277aad79c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c86 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.172442:0:15027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb907369400/0x42820277aad79c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79c86 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483108.172451:0:15027:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb910c1a000 from 1 10000000:01000000:1.0:1788483108.172454:0:15027:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483108.172492:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.172502:0:15027:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.172513:0:15027:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483108.172539:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788483108.172632:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.172678:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483108.172742:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072431104 00000100:00100000:2.0:1788483108.172750:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072431104 00000100:00100000:2.0:1788483108.172803:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788483108.172814:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+14:15027:x1875360072431104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483108.172831:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483108.172844:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79c9b expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.172880:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79c9b expref: 15 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.172890:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c9b expref: 15 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.172900:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67c00, rc 0) 00000100:00100000:2.0:1788483108.172946:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431104:12345-0@lo:101:mount.lustre.0 Request processed in 134us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.172952:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788483108.174829:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483108.174850:0:15027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.174858:0:15027:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788483108.178777:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788483108.179292:0:15027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788483108.179534:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788483108.179582:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788483108.179646:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788483108.179655:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788483108.179739:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483108.179820:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.179895:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483108.181010:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072431232 00000100:00100000:3.0:1788483108.181022:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072431232 00000100:00100000:3.0:1788483108.182599:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788483108.182616:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483108.182924:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431232:12345-0@lo:501:mount.lustre.0 Request processed in 314us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.182932:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788483108.183208:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483108.183292:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483108.183338:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.184607:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483108.184751:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072431360 00000100:00100000:2.0:1788483108.184762:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072431360 00000100:00100000:2.0:1788483108.184819:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788483108.184831:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483108.185105:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431360:12345-0@lo:503:mount.lustre.0 Request processed in 274us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.185113:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788483108.185587:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788483108.186342:0:15027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788483108.186452:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483108.186516:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.186659:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483108.187071:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072431488 00000100:00100000:3.0:1788483108.187087:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072431488 00000100:00100000:3.0:1788483108.187123:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788483108.187131:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483108.187354:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431488:12345-0@lo:502:mount.lustre.0 Request processed in 222us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.187362:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788483108.187466:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483108.187733:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788483108.187793:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788483108.187846:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788483108.187899:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788483108.187931:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788483108.187976:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788483108.188014:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788483108.188043:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788483108.188077:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483108.188127:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.188159:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483108.188225:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072431616 00000100:00100000:3.0:1788483108.188231:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072431616 00000100:00100000:3.0:1788483108.188301:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788483108.188309:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483108.188445:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431616:12345-0@lo:502:mount.lustre.0 Request processed in 136us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.188453:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788483108.188560:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483108.188640:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788483108.188650:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788483108.190742:0:15045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483108.190760:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483108.190763:0:15045:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788483108.190775:0:15045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb910c1a000 00000020:00000080:3.0:1788483108.190779:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483108.190787:0:15045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483108.190790:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483108.190791:0:15045:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788483108.190793:0:15045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483108.190796:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483108.190797:0:15045:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788483108.190800:0:15045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb910c1a000 00000020:00000080:3.0:1788483108.190802:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483108.190882:0:15045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483108.190887:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483108.190888:0:15045:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788483108.190890:0:15045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788483108.190908:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483108.190909:0:15045:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788483108.190913:0:15045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eb910c1a000 00000020:00000080:3.0:1788483108.190915:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788483108.190953:0:15045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788483108.190957:0:15045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483108.190959:0:15045:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788483108.190962:0:15045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788483108.198662:0:15027:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788483108.198714:0:15027:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788483108.198742:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.198756:0:15027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483108.198952:0:15027:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788483108.198955:0:15027:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eb910c1a000 10000000:01000000:2.0:1788483108.198959:0:15027:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eb910c1a000 10000000:01000000:2.0:1788483108.198964:0:15027:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788483108.198972:0:15027:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb910c1a000 from 1 10000000:01000000:2.0:1788483108.198975:0:15027:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788483108.199024:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb910c67000/0x42820277aad79ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.199033:0:15027:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb910c67000/0x42820277aad79ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.199047:0:15027:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb910c67000/0x42820277aad79ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483108.199074:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483108.199146:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483108.199198:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788483108.207507:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072431744 00000100:00100000:3.0:1788483108.207526:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072431744 00000100:00100000:3.0:1788483108.207612:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788483108.207626:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072431744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483108.207647:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483108.207670:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe15e00/0x42820277aad79cb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79ca9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.207702:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe15e00/0x42820277aad79cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79ca9 expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.207714:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe15e00/0x42820277aad79cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79ca9 expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.207725:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15e00, rc 0) 00000100:00100000:3.0:1788483108.207830:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072431744:12345-0@lo:101:mount.lustre.0 Request processed in 207us (8684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.207838:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788483108.207923:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483108.207941:0:15027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb910c67000/0x42820277aad79ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79cb0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.207964:0:15027:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb910c67000/0x42820277aad79ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79cb0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483108.208648:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788483108.209034:0:15027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483108.209379:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788483108.209422:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788483108.209450:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788483108.209496:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788483108.209531:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788483108.209595:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788483108.209630:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788483108.209663:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788483108.209725:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788483108.209763:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788483108.209795:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788483108.209838:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788483108.209885:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788483108.209916:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788483108.209961:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788483108.209995:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788483108.210026:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788483108.210072:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788483108.210106:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788483108.210138:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788483108.210178:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788483108.210222:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788483108.210281:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788483108.210327:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788483108.210362:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788483108.210396:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788483108.210468:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788483108.210508:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788483108.210584:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788483108.210592:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788483108.210695:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483108.210765:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483108.210833:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169480 going to sleep for 11 seconds 00000100:00100000:0.0:1788483108.211458:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072431872 00000100:00100000:0.0:1788483108.211467:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072431872 00000100:00100000:0.0:1788483108.211773:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788483108.211784:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072431872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483108.212119:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072431872:12345-0@lo:501:mount.lustre.0 Request processed in 336us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483108.212127:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788483108.212214:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072431872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483108.212287:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072432000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483108.212327:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.212617:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788483108.212681:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072432000 00000100:00100000:2.0:1788483108.212687:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072432000 00000100:00100000:2.0:1788483108.212721:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788483108.212729:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072432000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483108.213030:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072432000:12345-0@lo:503:mount.lustre.0 Request processed in 300us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483108.213038:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788483108.214023:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072432000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788483108.214659:0:15027:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788483108.214740:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072432128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483108.214800:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.214844:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483108.215293:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072432128 00000100:00100000:3.0:1788483108.215301:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072432128 00000100:00100000:3.0:1788483108.215343:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788483108.215352:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072432128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483108.215581:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072432128:12345-0@lo:502:mount.lustre.0 Request processed in 229us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.215589:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788483108.216054:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072432128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483108.216327:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788483108.216379:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788483108.216413:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788483108.216478:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788483108.216515:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788483108.216560:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788483108.216592:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788483108.216622:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788483108.216663:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788483108.216694:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788483108.216724:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788483108.216767:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788483108.216801:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788483108.216832:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788483108.220125:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788483108.220230:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788483108.220289:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788483108.220339:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788483108.220376:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788483108.220431:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788483108.220481:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788483108.220515:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788483108.220545:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788483108.220591:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788483108.220625:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788483108.220659:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788483108.220719:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788483108.220757:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788483108.220791:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788483108.220837:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788483108.223086:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788483108.223181:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788483108.223229:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788483108.223323:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788483108.223362:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788483108.223432:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788483108.223469:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788483108.223503:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788483108.223552:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788483108.223589:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788483108.223658:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072432256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483108.223762:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.223843:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483108.224244:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072432256 00000100:00100000:3.0:1788483108.224276:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072432256 00000100:00100000:3.0:1788483108.224336:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788483108.224347:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072432256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483108.225050:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072432256:12345-0@lo:502:mount.lustre.0 Request processed in 699us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.225061:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788483108.226945:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072432256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788483108.227100:0:15027:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788483108.227118:0:15027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788483108.230411:0:15050:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788483108.230430:0:15050:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9eb93b4e99b8) 00000020:00000080:1.0:1788483108.230453:0:15050:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788483108.230523:0:15050:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb910c1a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788483108.230527:0:15050:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb910c1a000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788483108.230529:0:15050:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb910c1a000 3 00010000:00080000:1.0:1788483108.230559:0:15050:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb93aad1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:1.0:1788483108.242477:0:15050:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788483108.242769:0:15050:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788483108.242820:0:15050:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788483108.242837:0:15050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x42820277aad79cbe 00000100:00080000:1.0:1788483108.242852:0:15050:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788483108.242859:0:15050:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9eb93aad1800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788483108.242917:0:15050:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9217e6d80 x1875360072432384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483108.243036:0:15050:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788483108.243520:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3276:1875360072432384:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788483108.243598:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483108.243775:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072432384 00000100:00100000:3.0:1788483108.243783:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072432384 00000100:00100000:3.0:1788483108.243814:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483108.243822:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3276:x1875360072432384:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788483108.243854:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:3.0:1788483108.243903:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x42820277aad79cc5 00000004:00100000:3.0:1788483108.243921:0:14347:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788483108.244064:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9eb94060b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788483108.244122:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875360072432384:12345-0@lo:38:llog_process_th.0 Request processed in 299us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.244131:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788483108.244174:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eb9217e6d80 x1875360072432384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483108.244183:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483108.244191:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788483108.244198:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788483108.244203:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788483108.244205:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb93aad1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788483108.244210:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3276:1875360072432384:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788483108.244475:0:15050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788483108.244525:0:15027:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788483108.244553:0:15027:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788483108.244571:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb910c67000/0x42820277aad79ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79cb0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.244583:0:15027:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb910c67000/0x42820277aad79ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79cb0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788483108.244638:0:15027:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788483108.244640:0:15027:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788483108.244642:0:15027:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483108.244643:0:15027:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483108.244644:0:15027:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483108.244645:0:15027:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483108.244647:0:15027:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483108.244649:0:15027:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483108.244650:0:15027:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788483108.244655:0:15027:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788483108.244657:0:15027:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788483108.244659:0:15027:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788483108.244660:0:15027:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788483108.244661:0:15027:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788483108.244662:0:15027:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788483108.244663:0:15027:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788483108.244664:0:15027:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788483108.244665:0:15027:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788483108.244666:0:15027:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788483108.244685:0:15027:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788483108.244700:0:15027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072432512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788483108.244749:0:15027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483108.244771:0:15027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788483108.245332:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072432512 00000100:00100000:1.0:1788483108.245339:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072432512 00000100:00100000:1.0:1788483108.245386:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788483108.245394:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15027:x1875360072432512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788483108.245418:0:14339:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788483108.245432:0:14339:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788483108.246381:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483108.246389:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483108.246392:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483108.246395:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788483108.246507:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072432640:0@lo:400:kworker.0 00000100:00100000:1.0:1788483108.246574:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483108.248183:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072432640 00000100:00100000:0.0:1788483108.248201:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072432640 00000100:00100000:0.0:1788483108.248667:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483108.248681:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072432640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483108.248788:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072432640:12345-0@lo:400:kworker.0 Request processed in 111us (2213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483108.248795:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788483108.249221:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9eb801ff7b80 x1875360072432640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483108.249275:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072432640:0@lo:400:kworker.0 20000000:01000000:1.0:1788483108.285687:0:14339:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788483108.285710:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788483108.285771:0:14361:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788483108.285778:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788483108.285807:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.285850:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c32 expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.285871:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.285927:0:14361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad79c32 expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.285956:0:14361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad79c32 expref: 16 pid: 14338 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483108.285976:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14361:1875360072432768:0@lo:104: 00000100:00100000:2.0:1788483108.286069:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483108.286303:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9086a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483108.286369:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072432768 00000100:00100000:1.0:1788483108.286378:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072432768 00000100:00100000:1.0:1788483108.286435:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483108.286445:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:14361:x1875360072432768:12345-0@lo:104: 00010000:00010000:1.0:1788483108.286459:0:14328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483108.286516:0:14328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788483108.286521:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:14361:x1875360072432768:12345-0@lo:104: Request processed in 79us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483108.286530:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483108.286619:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14361:1875360072432768:0@lo:104: 00010000:00010000:2.0:1788483108.286639:0:14361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.286707:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483108.286718:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.286727:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369a00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:3.0:1788483108.286733:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.286742:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483108.286750:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483108.286768:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788483108.286808:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.286816:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483108.286847:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.286855:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb907369a00/0x42820277aad79c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c39 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.286885:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483108.286887:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483108.286889:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483108.286903:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483108.286916:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072432896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483108.288582:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483108.288652:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072432896 00000100:00100000:3.0:1788483108.288660:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072432896 00010000:00010000:3.0:1788483108.288696:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79c32 expref: 17 pid: 14338 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483108.289393:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483108.289405:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:3278:x1875360072432896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483108.289422:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483108.289430:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79c32 expref: 17 pid: 14338 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289443:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad79c32 expref: 17 pid: 14338 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289480:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad79c32 expref: 17 pid: 14338 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289498:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289506:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788483108.289523:0:14332:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004189822s 00010000:00010000:3.0:1788483108.289527:0:14332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289535:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289541:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289547:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289552:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483108.289557:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289564:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289580:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483108.289598:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483108.289654:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3278:x1875360072432896:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483108.289661:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483108.289817:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072432896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483108.290355:0:14361:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.290366:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483108.290373:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb910c66a00/0x42820277aad79ccc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483108.297694:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:15027:x1875360072432512:12345-0@lo:253:mount.lustre.0 Request processed in 52286us (52931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483108.297727:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788483108.297856:0:15027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15027:1875360072432512:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788483108.297883:0:15027:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788483108.297886:0:15027:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788483108.297892:0:15027:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788483108.297893:0:15027:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483108.297895:0:15027:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483108.297896:0:15027:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483108.297897:0:15027:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483108.297899:0:15027:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483108.297901:0:15027:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483108.297902:0:15027:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788483108.297915:0:15027:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788483108.305827:0:15027:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788483108.306192:0:15027:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788483108.306432:0:15027:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788483108.306582:0:15027:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788483108.306728:0:15027:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788483108.306909:0:15027:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788483108.308060:0:15027:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788483108.366836:0:15027:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788483108.366849:0:15027:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788483108.366902:0:15027:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788483108.367057:0:15027:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788483108.367079:0:15027:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788483108.367463:0:15027:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788483108.406971:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483109.433824:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788483109.746394:0:14342:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788483109.746403:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eb92163b000 from 7 10000000:01000000:1.0:1788483109.746408:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483109.746467:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483109.746481:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483109.746495:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483109.746522:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072433024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483109.746597:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483109.746676:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483109.746827:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072433024 00000100:00100000:3.0:1788483109.746843:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072433024 00000100:00100000:3.0:1788483109.746910:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788483109.746918:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+15:14342:x1875360072433024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483109.746930:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483109.746943:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79cd3 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483109.746963:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79cd3 expref: 16 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483109.746970:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79cd3 expref: 16 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483109.746978:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14a00, rc 0) 00000100:00100000:3.0:1788483109.747019:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:14342:x1875360072433024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483109.747026:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788483109.747057:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072433024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483109.747076:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483109.747085:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483109.747141:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072433152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788483109.747171:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483109.747197:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9215f9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483109.747226:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072433152 00000100:00100000:0.0:1788483109.747231:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072433152 00000100:00100000:0.0:1788483109.747281:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788483109.747288:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb919cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:14342:x1875360072433152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788483109.747303:0:14338:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788483109.747319:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788483109.747323:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788483109.747406:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb919cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:14342:x1875360072433152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483109.747413:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788483109.747419:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072433152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788483109.747480:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788483109.747487:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483109.747494:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483110.454031:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483111.474505:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483112.498844:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788483113.398305:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483113.398312:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788483113.398315:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788483113.398318:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788483113.398387:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072433408:0@lo:400:kworker.0 00000100:00100000:2.0:1788483113.398458:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483113.398531:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788483113.398538:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072433536:0@lo:400:kworker.0 00000100:00100000:2.0:1788483113.398565:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483113.398608:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072433408 00000100:00100000:2.0:1788483113.398617:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072433408 00000100:00100000:2.0:1788483113.398660:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072433536 00000100:00100000:2.0:1788483113.398663:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072433536 00000100:00100000:2.0:1788483113.398700:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788483113.398820:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483113.398831:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3277:1875360072433280:0@lo:400:kworker.0 00000100:00100000:0.0:1788483113.398871:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483113.398980:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072433408:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788483113.399210:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483113.400853:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072433408:12345-0@lo:400:kworker.0 Request processed in 2135us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483113.400869:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483113.400906:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483113.400922:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072433536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483113.400990:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072433536:12345-0@lo:400:kworker.0 Request processed in 77us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483113.401008:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483113.401042:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072433280 00000100:00100000:2.0:1788483113.401050:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072433280 00000100:00100000:2.0:1788483113.401091:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788483113.401097:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3277:x1875360072433280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483113.401128:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3277:x1875360072433280:12345-0@lo:400:kworker.0 Request processed in 32us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483113.401134:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788483113.401183:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3277:1875360072433280:0@lo:400:kworker.0 00010000:00080000:1.0:1788483113.405585:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92eb47800 x1875360072433408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483113.405615:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072433408:0@lo:400:kworker.0 00010000:00080000:1.0:1788483113.405661:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb92eb44700 x1875360072433536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788483113.405670:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072433536:0@lo:400:kworker.0 00010000:00010000:0.0:1788483113.522408:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483114.547246:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788483114.823126:0:15393:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788483115.573075:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483116.083385:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788483116.596907:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483117.618768:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483118.514584:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483118.514593:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788483118.514596:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483118.514607:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788483118.514660:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3277:1875360072433664:0@lo:400:kworker.0 00000100:00100000:0.0:1788483118.514760:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483118.514816:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483118.514822:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072433792:0@lo:400:kworker.0 00000100:00100000:0.0:1788483118.514851:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483118.514884:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072433920:0@lo:400:kworker.0 00000100:00100000:0.0:1788483118.514913:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483118.514949:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072433664 00000100:00100000:0.0:1788483118.514955:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072433664 00000100:00100000:0.0:1788483118.515001:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788483118.515010:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3277:x1875360072433664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483118.515061:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3277:x1875360072433664:12345-0@lo:400:kworker.0 Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483118.515068:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788483118.515101:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072433792 00000100:00100000:0.0:1788483118.515105:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072433792 00000100:00100000:0.0:1788483118.515128:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072433920 00000100:00100000:0.0:1788483118.515131:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072433920 00000100:00100000:0.0:1788483118.515157:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788483118.515164:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072433792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483118.515196:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072433792:12345-0@lo:400:kworker.0 Request processed in 33us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483118.515202:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788483118.515213:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483118.515218:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072433920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483118.515297:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072433920:12345-0@lo:400:kworker.0 Request processed in 79us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483118.515303:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788483118.515330:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788483118.515358:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb801ff6a00 x1875360072433920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483118.515373:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072433920:0@lo:400:kworker.0 00010000:00080000:0.0:1788483118.515400:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb801ff4a80 x1875360072433792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483118.515408:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072433792:0@lo:400:kworker.0 00000100:00100000:0.0:1788483118.515417:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3277:1875360072433664:0@lo:400:kworker.0 00010000:00010000:3.0:1788483118.644825:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483119.542308:0:3276:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483104/real 1788483104] req@ffff9eb9217e4a80 x1875360072429696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483119.542363:0:3276:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eb9217e4a80 x1875360072429696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483119.542376:0:3276:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788483104/real 1788483104] req@ffff9eb9217e7480 x1875360072429824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483119.542389:0:3276:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9eb9217e7480 x1875360072429824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788483119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788483119.542417:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb92087e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788483119.542964:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788483119.542972:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072429696:0@lo:8:kworker.0 00000100:00080000:3.0:1788483119.542981:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788483119.543960:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483119.543968:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788483119.543972:0:38:0:(import.c:65:import_set_state_nolock()) ffff9eb92087e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483119.543979:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1788483119.543986:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483119.543996:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9eb92087e000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788483119.544025:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9217e5f80 x1875360072434176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788483119.544037:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788483119.544040:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788483119.544060:0:38:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788483119.544064:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1788483119.544067:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788483119.544071:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eb902d3e000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788483119.544084:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb9217e5500 x1875360072434304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788483119.544152:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3280:1875360072434048:0@lo:400:kworker.0 00000100:00100000:1.0:1788483119.544281:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788483119.544472:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788483119.544481:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072429824:0@lo:8:kworker.0 00000100:00100000:3.0:1788483119.544518:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072434176:0@lo:8:kworker.0 00000100:00100000:3.0:1788483119.544557:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483119.547988:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072434432:0@lo:400:kworker.0 00000100:00100000:0.0:1788483119.548097:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483119.548288:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072434048 00000100:00100000:1.0:1788483119.548302:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072434048 00000100:00100000:1.0:1788483119.548372:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788483119.548385:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3280:x1875360072434048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483119.548479:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3280:x1875360072434048:12345-0@lo:400:kworker.0 Request processed in 96us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483119.548488:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788483119.548589:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3280:1875360072434048:0@lo:400:kworker.0 00000100:00100000:1.0:1788483119.549856:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072434176 00000100:00100000:1.0:1788483119.549867:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072434176 00000100:00100000:1.0:1788483119.549913:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483119.549921:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3276:x1875360072434176:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788483119.549958:0:15028:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:1.0:1788483119.549996:0:15028:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad79ce1 00002000:00100000:1.0:1788483119.550015:0:15028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9eb93aad7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788483119.550020:0:15028:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788483119.550023:0:15028:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788483119.550441:0:15028:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788483119.550475:0:15028:0:(import.c:65:import_set_state_nolock()) ffff9eb93aad4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483119.550559:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3276:x1875360072434176:12345-0@lo:8:kworker.0 Request processed in 637us (5999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483119.550568:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788483119.550603:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072434560:0@lo:400:kworker.0 00000100:00100000:1.0:1788483119.550646:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788483119.551989:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb9217e5f80 x1875360072434176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483119.552009:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788483119.552024:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788483119.552036:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788483119.552054:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788483119.552059:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb92087e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788483119.552092:0:3276:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788483119.552101:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072434176:0@lo:8:kworker.0 00000100:00100000:3.0:1788483119.552115:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072434304:0@lo:8:kworker.0 00000100:00100000:3.0:1788483119.552174:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483119.552324:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072434432 00000100:00100000:3.0:1788483119.552333:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072434432 00000100:00100000:3.0:1788483119.552400:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072434560 00000100:00100000:3.0:1788483119.552404:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072434560 00000100:00100000:3.0:1788483119.552430:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483119.552441:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072434432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483119.552500:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072434432:12345-0@lo:400:kworker.0 Request processed in 61us (4404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483119.552507:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483119.552525:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788483119.552531:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072434560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483119.552563:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072434560:12345-0@lo:400:kworker.0 Request processed in 32us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483119.552569:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:1.0:1788483119.552797:0:14368:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788483119.552826:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14368:1875360072434816:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788483119.552861:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483119.552881:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910db0240 going to sleep for 11 seconds 00000004:00080000:1.0:1788483119.552974:0:14367:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788483119.553426:0:14367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436719176150ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788483119.553471:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072434304 00000100:00100000:1.0:1788483119.553478:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072434304 00000100:00100000:1.0:1788483119.553497:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072434816 00000100:00100000:1.0:1788483119.553501:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072434816 00000100:00100000:1.0:1788483119.553543:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788483119.553549:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3276:x1875360072434304:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788483119.553574:0:15031:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788483119.553633:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3276:x1875360072434304:12345-0@lo:8:kworker.0 Request processed in 83us (1458us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788483119.553642:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788483119.553659:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483119.553679:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14368:x1875360072434816:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788483119.554023:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788483119.554066:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb9217e7100 x1875360072434432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483119.554083:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072434432:0@lo:400:kworker.0 00000100:00100000:3.0:1788483119.554845:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072434688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483119.554989:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788483119.555373:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb9217e4380 x1875360072434560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483119.555391:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072434560:0@lo:400:kworker.0 00000100:00100000:2.0:1788483119.556994:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072434688 00000100:00100000:2.0:1788483119.557009:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072434688 00000100:00100000:2.0:1788483119.557073:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483119.557087:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072434688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483119.557136:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788483119.557241:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875360072434688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483119.557269:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788483119.557328:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb9217e7b80 x1875360072434688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788483119.557351:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072434688:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788483119.558398:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483119.558408:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788483119.558411:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072434304:0@lo:8:kworker.0 00002000:00080000:1.0:1788483119.560705:0:15031:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788483119.560720:0:15031:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788483119.562576:0:15031:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788483119.571707:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.571723:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.571745:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.571750:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.571759:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.571780:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.571791:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.571800:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.571841:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.571868:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.571877:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.571886:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.571970:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.571996:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.572019:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.572026:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058ffe39c/0x42820277aad79ce8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.572061:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.572067:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.572071:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.576046:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.576063:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.576166:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.576172:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.576180:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.576195:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.576294:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.576311:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.576344:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483119.576766:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483119.576773:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.576782:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626200 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.576787:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.576796:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.576815:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.576823:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000930ff524/0x42820277aad79cef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.576845:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.576847:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.576849:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.578828:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.578844:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.578862:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.578867:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.578874:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.578955:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.578968:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.578975:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.578999:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.579017:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.579023:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.579043:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.579048:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.579056:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.579071:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.579078:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000053b9889/0x42820277aad79cf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.579095:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.579099:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.579101:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.580510:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.580520:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.580533:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.580537:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.580542:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.580553:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.580570:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.580579:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.580742:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483119.581217:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.581223:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.581232:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.581235:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.581240:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.581276:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.581284:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.581293:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.581489:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483119.581500:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.581509:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.581515:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.581537:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.581555:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.581561:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085def95a/0x42820277aad79cfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.581583:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483119.581587:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.581594:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.581597:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.582469:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.582484:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.582495:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.582497:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.582511:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.582744:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788483119.582751:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061b2f670/0x42820277aad79d04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483119.584550:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.584561:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.584575:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.584580:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.584586:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.584598:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.584986:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.584996:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.585067:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483119.585075:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.585085:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.585090:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.585099:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.585118:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.585169:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.585171:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.585173:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.585461:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788483119.585468:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c52417b/0x42820277aad79d0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.585519:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.587578:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.587591:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.587790:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.587796:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.587803:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.587819:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.587831:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.587840:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.587873:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.588002:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.588009:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.588018:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626c00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.588032:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.588042:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.588061:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.588069:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b28e2d/0x42820277aad79d12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.588096:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.588099:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.588101:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.589408:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.589419:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589431:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.589435:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.589440:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589451:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589460:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589476:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589498:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.589512:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.589517:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589525:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.589529:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589537:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589551:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589558:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e45f4aa/0x42820277aad79d19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.589575:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.589576:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.589578:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.592579:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.592800:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.592819:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.592824:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.592831:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.592845:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.592856:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.592864:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.592998:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.593018:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.593024:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.593031:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627c00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.593038:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.593048:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.593080:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.593088:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc077eda/0x42820277aad79d20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.593113:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.593116:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.593117:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.594146:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.594156:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594169:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.594173:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.594178:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594188:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594411:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594421:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594455:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.594470:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.594475:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594482:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.594486:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594495:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594508:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594516:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067214bcc/0x42820277aad79d27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.594533:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.594534:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.594536:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.595542:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.595552:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.595566:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.595576:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.595581:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.595593:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.595796:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.595808:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.595837:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.595853:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.595858:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.595866:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.595869:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.595877:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.596037:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.596057:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf3bcd0f/0x42820277aad79d2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.596080:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.596082:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.596083:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.597150:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.597161:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.597173:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.597177:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.597183:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.597196:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.597410:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.597419:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.597447:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.597461:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.597473:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.597481:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.597485:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.598028:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.598046:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.598054:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000227bba8c/0x42820277aad79d35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.598079:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.598082:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.598084:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.600089:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.600101:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.600117:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.600121:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.600127:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.600154:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.600165:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.600173:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.600877:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.600996:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.601004:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.601013:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.601019:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.601028:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.601051:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.601059:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.601096:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.601098:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.601100:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.602852:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.602863:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.602878:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.603100:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.603109:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.603124:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.603135:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.603143:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.603170:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.603188:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.603194:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.603229:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.603234:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.603242:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.603984:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.603994:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.604018:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.604020:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.604025:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.609240:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.609586:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.609796:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.609802:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.609810:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.609830:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.609854:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.609864:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.610082:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483119.610694:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.610703:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.610713:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.610728:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.610734:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.610744:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.610751:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.610758:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611519:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483119.611531:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611542:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.611549:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611558:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611612:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611620:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611649:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483119.611653:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611662:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204ae00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.611676:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611684:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611696:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.611704:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.611708:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.611711:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.612463:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788483119.612473:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.612509:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.615030:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.615046:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.615065:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.615069:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.615077:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.615090:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.615101:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.615110:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.617156:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483119.619528:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.619546:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.619563:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.619567:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.619573:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.619588:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.619785:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.619795:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.619833:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788483119.619854:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483119.619861:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.619869:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.619876:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620080:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620111:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620119:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d279ce26/0x42820277aad79d58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620146:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.620150:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620157:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.620161:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620167:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620176:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620182:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3a9aa05/0x42820277aad79d5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.620205:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.620207:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.620217:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.621816:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.621827:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.621843:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.621847:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.621853:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.621865:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.621875:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.621884:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.622060:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.622152:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483119.622833:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483119.622842:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.622867:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204a200 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.622872:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.622884:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.623540:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.623549:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053a4a8d4/0x42820277aad79d66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.623568:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.623569:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.623571:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.627190:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.627538:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.627562:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.627568:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.627575:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.627781:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.627795:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.627804:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.627857:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483119.628576:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.628583:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.628594:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.628598:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.628616:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.628626:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.628635:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.628655:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629207:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483119.629216:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629227:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204ae00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.629232:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629243:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629400:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629408:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b4989ed/0x42820277aad79d6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629433:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483119.629436:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629442:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204aa00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.629446:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629454:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629462:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.629468:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.629470:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.629471:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.629559:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788483119.629565:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58e2c29/0x42820277aad79d74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788483119.630416:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.630424:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630436:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.630440:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.630445:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630456:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630465:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630473:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630730:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483119.630746:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.630751:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630758:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204be00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.630762:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630769:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630782:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630790:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e729c338/0x42820277aad79d7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.630815:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.630818:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.630820:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.632010:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.632024:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.632038:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.632054:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.632060:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.632073:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.632084:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.632091:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.632110:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483119.633194:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.633413:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633428:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.633432:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.633438:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633453:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633463:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633480:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633505:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788483119.633524:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788483119.633529:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633538:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204a400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483119.633542:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633551:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633569:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.633576:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fb7ce38/0x42820277aad79d82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.633836:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483119.634052:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.634055:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483119.634056:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788483119.635583:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.635806:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.635831:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.635837:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.635844:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.635862:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.635875:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.635883:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.636038:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788483119.636832:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788483119.636840:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.636855:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1788483119.636859:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788483119.636864:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.636878:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.637101:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.637110:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.637885:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483119.637899:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.637924:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb9421d2600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.637929:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.637940:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.637964:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.637971:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e403bbf/0x42820277aad79d90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483119.638050:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483119.640956:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483119.640979:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.640997:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb9421d2800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483119.641002:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.641014:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.641042:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.641075:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c24d0fd/0x42820277aad79d97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483119.641102:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.641105:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483119.641108:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483119.641497:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483119.641514:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.641529:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb94204b800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483119.641534:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.641546:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.641570:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.641579:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a72b3959/0x42820277aad79d89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.641606:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483119.641608:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483119.641611:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483119.641615:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483119.641617:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788483119.647959:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788483119.650492:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483119.650512:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.650539:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=436s v=(0 0) 00010000:00010000:2.0:1788483119.650556:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483119.650566:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.650586:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.650600:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.650610:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.650640:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483119.650660:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483119.650682:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.650692:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66200 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483119.650699:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.650710:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.651463:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.651492:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026c5e7fd/0x42820277aad79d9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483119.651519:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483119.651521:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483119.651523:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788483119.651982:0:15031:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1788483119.652146:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14368:x1875360072434816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98474us (99277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483119.652166:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483119.652975:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14368:1875360072434816:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788483119.652996:0:14368:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788483119.653051:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14368:1875360072434944:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788483119.653124:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483119.653220:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072434944 00000100:00100000:2.0:1788483119.653234:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072434944 00000100:00100000:1.0:1788483119.653778:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb913b93b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788483119.654537:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483119.654559:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14368:x1875360072434944:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788483119.654561:0:15028:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788483119.654579:0:15028:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1788483119.654645:0:15030:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788483119.686622:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14368:x1875360072434944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 32058us (33482us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788483119.686700:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14368:1875360072434944:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788483119.686725:0:14368:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:3.0:1788483119.687087:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788483119.687585:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483120.690483:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788483121.709812:0:15745:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788483121.709816:0:15745:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788483121.709967:0:15745:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9eb93a96c000 00000020:01000004:2.0:1788483121.709986:0:15745:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788483121.709999:0:15745:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788483121.710017:0:15745:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9eb9377019b8) 00000020:00000080:2.0:1788483121.710034:0:15745:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1788483121.715922:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788483121.747924:0:15745:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788483121.748212:0:15745:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788483121.750637:0:15745:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788483121.752152:0:15745:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788483121.752397:0:15745:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788483121.754866:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 177: rc = 0 00100000:10000000:3.0:1788483121.756028:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 177: rc = 0 00100000:10000000:3.0:1788483121.756189:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 177: rc = 0 00100000:10000000:3.0:1788483121.761877:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 569: rc = 0 00100000:10000000:3.0:1788483121.762479:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 569: rc = 0 00100000:10000000:3.0:1788483121.764130:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 569: rc = 0 00100000:10000000:3.0:1788483121.764472:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 569: rc = 0 00100000:10000000:3.0:1788483121.765961:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 569: rc = 0 00100000:10000000:3.0:1788483121.766242:0:15745:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 569: rc = 0 00000020:00000080:2.0:1788483121.767146:0:15745:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788483121.767159:0:15745:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788483121.767170:0:15745:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x42820277aad79dac 00000020:01000004:2.0:1788483121.767178:0:15745:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788483121.767285:0:15745:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788483121.767289:0:15745:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788483121.767296:0:15745:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788483121.767319:0:15745:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788483121.767328:0:15745:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788483121.779581:0:15745:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788483121.779648:0:15745:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788483121.779653:0:15745:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788483121.779655:0:15745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788483121.779656:0:15745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483121.779657:0:15745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483121.779658:0:15745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483121.779659:0:15745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483121.779661:0:15745:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483121.779662:0:15745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483121.779665:0:15745:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788483121.779726:0:15745:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788483121.779729:0:15745:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788483121.779731:0:15745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788483121.779732:0:15745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483121.779733:0:15745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483121.779734:0:15745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483121.779735:0:15745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483121.779736:0:15745:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483121.779737:0:15745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483121.779739:0:15745:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788483121.779778:0:15745:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788483121.779805:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435072:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788483121.779904:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.779984:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066aa480 going to sleep for 11 seconds 00000100:00100000:0.0:1788483121.780082:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072435072 00000100:00100000:0.0:1788483121.780093:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072435072 00000100:00100000:0.0:1788483121.780157:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788483121.780168:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15745:x1875360072435072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788483121.780205:0:14339:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788483121.780209:0:14339:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788483121.780213:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788483121.793689:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15745:x1875360072435072:12345-0@lo:253:mount.lustre.0 Request processed in 13511us (13773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483121.793706:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788483121.793830:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788483121.793849:0:15745:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788483121.793853:0:15745:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788483121.793855:0:15745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788483121.793857:0:15745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788483121.793859:0:15745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788483121.793861:0:15745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788483121.793862:0:15745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788483121.793864:0:15745:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788483121.793866:0:15745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788483121.793888:0:15745:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788483121.793917:0:15745:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9eb93a96c000 from lustre-OST0001 10000000:01000000:2.0:1788483121.793947:0:15745:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788483121.793951:0:15745:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788483121.793959:0:15745:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9eb93f3919b8 local copy 00010000:00010000:2.0:1788483121.793971:0:15745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483121.794294:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483121.794340:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.794390:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788483121.794518:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072435200 00000100:00100000:1.0:1788483121.794526:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072435200 00000100:00100000:1.0:1788483121.794572:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788483121.794581:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15745:x1875360072435200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483121.794751:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15745:x1875360072435200:12345-0@lo:501:mount.lustre.0 Request processed in 170us (410us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788483121.794758:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788483121.795669:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435200:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788483121.795695:0:15745:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788483121.795938:0:15745:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788483121.795948:0:15745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.795959:0:15745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15800/0x42820277aad79b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79b60 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483121.795989:0:15745:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9eb93a96c000 10000000:01000000:3.0:1788483121.796002:0:15745:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788483121.796008:0:15745:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788483121.796010:0:15745:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788483121.796015:0:15745:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788483121.796018:0:15745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788483121.796052:0:15745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14c00/0x42820277aad79db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.796060:0:15745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14c00/0x42820277aad79db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.796071:0:15745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14c00/0x42820277aad79db3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483121.796092:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483121.796146:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.796199:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb923e093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483121.796407:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072435328 00000100:00100000:1.0:1788483121.796421:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072435328 00000100:00100000:1.0:1788483121.796472:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788483121.796480:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:15745:x1875360072435328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483121.796491:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483121.796504:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d3000/0x42820277aad79dba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79db3 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483121.796526:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d3000/0x42820277aad79dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79db3 expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483121.796536:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d3000/0x42820277aad79dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79db3 expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483121.796544:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d3000, rc 0) 00000100:00100000:1.0:1788483121.796588:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435328:12345-0@lo:101:mount.lustre.0 Request processed in 109us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483121.796706:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788483121.796724:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483121.796737:0:15745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14c00/0x42820277aad79db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79dba expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.796746:0:15745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14c00/0x42820277aad79db3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79dba expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483121.800919:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788483121.804545:0:15745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483121.804882:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788483121.805130:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788483121.805165:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788483121.805212:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788483121.805338:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788483121.805379:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788483121.805441:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788483121.805449:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788483121.805554:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483121.805638:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.805766:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483121.805832:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072435456 00000100:00100000:1.0:1788483121.805840:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072435456 00000100:00100000:1.0:1788483121.805936:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788483121.805955:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788483121.807456:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435456:12345-0@lo:501:mount.lustre.0 Request processed in 1506us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483121.807468:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788483121.807588:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483121.807653:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483121.807696:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.807982:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb923e096c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483121.808208:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072435584 00000100:00100000:2.0:1788483121.808217:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072435584 00000100:00100000:2.0:1788483121.808283:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788483121.808293:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483121.808647:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435584:12345-0@lo:503:mount.lustre.0 Request processed in 355us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483121.808656:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788483121.809291:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435584:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788483121.810876:0:15745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788483121.811081:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483121.811157:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.811212:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb923e096c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483121.811244:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072435712 00000100:00100000:1.0:1788483121.811286:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072435712 00000100:00100000:1.0:1788483121.811339:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788483121.811360:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483121.811604:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435712:12345-0@lo:502:mount.lustre.0 Request processed in 246us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483121.811613:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788483121.811654:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483121.811889:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788483121.812043:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788483121.812089:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788483121.812137:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788483121.812172:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788483121.812200:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788483121.812237:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788483121.812340:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788483121.812384:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788483121.812412:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483121.812452:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.812530:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb923e096c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483121.812573:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072435840 00000100:00100000:2.0:1788483121.812579:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072435840 00000100:00100000:0.0:1788483121.812669:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788483121.812681:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483121.812872:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435840:12345-0@lo:502:mount.lustre.0 Request processed in 194us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.812880:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788483121.813051:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483121.813104:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788483121.813113:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788483121.814048:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788483121.814059:0:15746:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788483121.814066:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788483121.814068:0:15746:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788483121.814072:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788483121.814092:0:15746:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9eb93f64cd28) 00000020:00000080:3.0:1788483121.814130:0:15746:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788483121.814134:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788483121.814198:0:15746:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb93a96c000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788483121.814204:0:15746:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788483121.814208:0:15746:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x42820277aad79dc8 00010000:00010000:3.0:1788483121.819136:0:15746:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788483121.820863:0:15746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788483121.826716:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788483121.833121:0:15746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788483121.833134:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483121.833140:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.833143:0:15746:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788483121.833147:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483121.833151:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.833152:0:15746:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788483121.833155:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788483121.833157:0:15746:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788483121.833160:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483121.833162:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.833163:0:15746:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788483121.833165:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483121.833168:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.833169:0:15746:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788483121.833173:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788483121.833239:0:15746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483121.833243:0:15746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.833245:0:15746:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788483121.833280:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788483121.834727:0:15745:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788483121.834766:0:15745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788483121.834795:0:15745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14c00/0x42820277aad79db3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79dba expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.834808:0:15745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14c00/0x42820277aad79db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79dba expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483121.834817:0:15745:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb93a96c000 from 1 10000000:01000000:2.0:1788483121.834820:0:15745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788483121.834856:0:15745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.834864:0:15745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.834875:0:15745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483121.834903:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788483121.834998:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.835046:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483121.838689:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072435968 00000100:00100000:1.0:1788483121.838705:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072435968 00000100:00100000:1.0:1788483121.838770:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788483121.838780:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:15745:x1875360072435968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788483121.838798:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483121.838815:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79dcf expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483121.838854:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79dcf expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483121.838865:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79dcf expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483121.838875:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d2a00, rc 0) 00000100:00100000:1.0:1788483121.838964:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072435968:12345-0@lo:101:mount.lustre.0 Request processed in 185us (3966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483121.838971:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788483121.839020:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072435968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788483121.839041:0:15745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.839051:0:15745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483121.840468:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788483121.847725:0:15745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483121.849584:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788483121.849665:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788483121.849752:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788483121.849760:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788483121.851388:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483121.851461:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.851502:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483121.851584:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072436096 00000100:00100000:0.0:1788483121.851593:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072436096 00000100:00100000:0.0:1788483121.851685:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788483121.851697:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9293a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483121.852022:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9293a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436096:12345-0@lo:501:mount.lustre.0 Request processed in 327us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.852031:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788483121.852112:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788483121.852152:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436224:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788483121.852190:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.858704:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483121.863643:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072436224 00000100:00100000:1.0:1788483121.863661:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072436224 00000100:00100000:1.0:1788483121.863736:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788483121.863748:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9293a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788483121.864076:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9293a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436224:12345-0@lo:503:mount.lustre.0 Request processed in 329us (11884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483121.864086:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788483121.864226:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436224:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788483121.864962:0:15745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788483121.865087:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483121.865152:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.865205:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483121.865325:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072436352 00000100:00100000:1.0:1788483121.865333:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072436352 00000100:00100000:1.0:1788483121.865372:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788483121.865381:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9293a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483121.865587:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9293a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436352:12345-0@lo:502:mount.lustre.0 Request processed in 205us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483121.865595:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788483121.866694:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788483121.867065:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788483121.867134:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788483121.867190:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788483121.867228:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788483121.870889:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788483121.871076:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788483121.871154:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788483121.871189:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788483121.871281:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788483121.871393:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.871449:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb91831e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483121.871548:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072436480 00000100:00100000:1.0:1788483121.871560:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072436480 00000100:00100000:1.0:1788483121.871644:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788483121.871655:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788483121.871900:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436480:12345-0@lo:502:mount.lustre.0 Request processed in 246us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483121.871908:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788483121.872110:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483121.872231:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788483121.872244:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788483121.873199:0:15750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483121.873210:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.873213:0:15750:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788483121.873221:0:15750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb93a96c000 00000020:00000080:1.0:1788483121.873223:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788483121.873230:0:15750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483121.873232:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.873233:0:15750:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788483121.873235:0:15750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483121.873237:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.873238:0:15750:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788483121.873241:0:15750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9eb93a96c000 00000020:00000080:1.0:1788483121.873243:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788483121.873339:0:15750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483121.873343:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.873345:0:15750:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788483121.873347:0:15750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788483121.873350:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.873351:0:15750:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788483121.873355:0:15750:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9eb93a96c000 00000020:00000080:1.0:1788483121.873356:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788483121.873388:0:15750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788483121.873392:0:15750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788483121.873393:0:15750:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788483121.873396:0:15750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788483121.873567:0:15745:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788483121.873596:0:15745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788483121.873622:0:15745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.873642:0:15745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483121.873687:0:15745:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788483121.873690:0:15745:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9eb93a96c000 10000000:01000000:3.0:1788483121.873693:0:15745:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9eb93a96c000 10000000:01000000:3.0:1788483121.873697:0:15745:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788483121.873702:0:15745:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9eb93a96c000 from 1 10000000:01000000:3.0:1788483121.873704:0:15745:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788483121.873738:0:15745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15a00/0x42820277aad79ddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.873745:0:15745:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15a00/0x42820277aad79ddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.873767:0:15745:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15a00/0x42820277aad79ddd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483121.873790:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788483121.873858:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.873920:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483121.873984:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072436608 00000100:00100000:0.0:1788483121.873991:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072436608 00000100:00100000:0.0:1788483121.874044:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788483121.874055:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072436608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788483121.874070:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483121.874085:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907368c00/0x42820277aad79de4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79ddd expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483121.874113:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907368c00/0x42820277aad79de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79ddd expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483121.874124:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907368c00/0x42820277aad79de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79ddd expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483121.874133:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368c00, rc 0) 00000100:00100000:0.0:1788483121.874171:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072436608:12345-0@lo:101:mount.lustre.0 Request processed in 118us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.874178:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788483121.874285:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788483121.874300:0:15745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15a00/0x42820277aad79ddd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79de4 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.874310:0:15745:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15a00/0x42820277aad79ddd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79de4 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788483121.874975:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788483121.878857:0:15745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788483121.879272:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788483121.879324:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788483121.879359:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788483121.879405:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788483121.879440:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788483121.879484:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788483121.879518:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788483121.879551:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788483121.879597:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788483121.879645:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788483121.879681:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788483121.879729:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788483121.879766:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788483121.879819:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788483121.879879:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788483121.879914:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788483121.879950:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788483121.879998:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788483121.880036:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788483121.880070:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788483121.880136:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788483121.880172:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788483121.880204:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788483121.880288:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788483121.880327:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788483121.880362:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788483121.880407:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788483121.880440:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788483121.880471:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788483121.880538:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788483121.880573:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788483121.880603:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788483121.884766:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788483121.885146:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788483121.885185:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788483121.885230:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788483121.885286:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788483121.885392:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788483121.885400:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788483121.885532:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483121.885641:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.885726:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483121.886323:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072436736 00000100:00100000:0.0:1788483121.886335:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072436736 00000100:00100000:0.0:1788483121.886403:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788483121.886415:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072436736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788483121.886747:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072436736:12345-0@lo:501:mount.lustre.0 Request processed in 333us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.886766:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788483121.892643:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788483121.892722:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788483121.892823:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.892887:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483121.899734:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072436864 00000100:00100000:2.0:1788483121.899752:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072436864 00000100:00100000:2.0:1788483121.899817:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788483121.899830:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072436864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788483121.900559:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072436864:12345-0@lo:503:mount.lustre.0 Request processed in 729us (7734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.900567:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788483121.900658:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436864:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788483121.901422:0:15745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788483121.901502:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483121.901560:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.901661:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e3bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483121.902768:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072436992 00000100:00100000:0.0:1788483121.902786:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072436992 00000100:00100000:0.0:1788483121.902857:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788483121.902869:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072436992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483121.903425:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072436992:12345-0@lo:502:mount.lustre.0 Request processed in 557us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.903435:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788483121.903465:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072436992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788483121.903764:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788483121.903809:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788483121.903828:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788483121.903863:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788483121.903897:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788483121.903954:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788483121.903989:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788483121.904022:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788483121.904069:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788483121.904105:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788483121.904135:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788483121.904177:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788483121.904206:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788483121.904223:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788483121.904289:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788483121.904315:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788483121.904331:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788483121.904369:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788483121.904391:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788483121.904407:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788483121.904444:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788483121.904471:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788483121.904487:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788483121.904512:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788483121.904530:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788483121.904545:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788483121.904568:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788483121.904585:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788483121.904601:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788483121.904635:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788483121.904672:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788483121.904702:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788483121.904734:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788483121.904795:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788483121.904831:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788483121.905133:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788483121.905169:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788483121.905198:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788483121.905244:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788483121.905307:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788483121.905353:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072437120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788483121.905433:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483121.905480:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9232fd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788483121.907232:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072437120 00000100:00100000:3.0:1788483121.907324:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072437120 00000100:00100000:3.0:1788483121.907425:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788483121.907438:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072437120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788483121.907800:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072437120:12345-0@lo:502:mount.lustre.0 Request processed in 364us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483121.907808:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788483121.907905:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072437120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788483121.908008:0:15745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788483121.908024:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788483121.909100:0:15755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788483121.909118:0:15755:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9eb93f648000) 00000020:00000080:3.0:1788483121.909141:0:15755:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788483121.909225:0:15755:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9eb93a96c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788483121.909230:0:15755:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9eb93a96c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788483121.909233:0:15755:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9eb93a96c000 3 00010000:00080000:3.0:1788483121.910170:0:15755:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9eb803317800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788483121.911810:0:15755:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788483121.912080:0:15755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788483121.912135:0:15755:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788483121.912152:0:15755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x42820277aad79df2 00000100:00080000:3.0:1788483121.912166:0:15755:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788483121.912174:0:15755:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9eb803317800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788483121.912212:0:15755:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb903111c00 x1875360072437248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788483121.912244:0:15755:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788483121.912407:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3276:1875360072437248:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788483121.912500:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788483121.914348:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483121.914355:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483121.914368:0:36:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483121.914376:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:0.0:1788483121.914381:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788483121.914386:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eb902d3e000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788483121.914408:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb801ff4e00 x1875360072437504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483121.914466:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072437376:0@lo:400:kworker.0 00000100:00100000:0.0:1788483121.914528:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483121.914594:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072437504:0@lo:8:kworker.0 00000100:00100000:0.0:1788483121.914622:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483121.914663:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072437632:0@lo:400:kworker.0 00000100:00100000:0.0:1788483121.914689:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483121.914709:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483121.914715:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072437760:0@lo:400:kworker.0 00000100:00100000:0.0:1788483121.914736:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483121.914765:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072437376 00000100:00100000:0.0:1788483121.914774:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072437376 00000100:00100000:0.0:1788483121.914835:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072437504 00000100:00100000:0.0:1788483121.914838:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072437504 00000100:00100000:0.0:1788483121.914861:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483121.914873:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1875360072437376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483121.914932:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1875360072437376:12345-0@lo:400:kworker.0 Request processed in 60us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.914942:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788483121.914959:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788483121.914964:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3276:x1875360072437504:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788483121.915020:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3276:x1875360072437504:12345-0@lo:8:kworker.0 Request processed in 54us (396us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788483121.915026:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788483121.915043:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072437248 00000100:00100000:0.0:1788483121.915047:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072437248 00000100:00100000:0.0:1788483121.915063:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072437632 00000100:00100000:0.0:1788483121.915066:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072437632 00000100:00100000:0.0:1788483121.915080:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072437760 00000100:00100000:0.0:1788483121.915082:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072437760 00000100:00100000:0.0:1788483121.915096:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483121.915103:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072437632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483121.915136:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875360072437632:12345-0@lo:400:kworker.0 Request processed in 34us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.915143:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788483121.915153:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788483121.915158:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072437760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483121.915183:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875360072437760:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.915188:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788483121.915198:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483121.915202:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3276:x1875360072437248:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788483121.915216:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:0.0:1788483121.915279:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x42820277aad79df9 00000004:00100000:0.0:1788483121.915295:0:14347:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788483121.915323:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9eb929356800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483121.915356:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875360072437248:12345-0@lo:38:llog_process_th.0 Request processed in 152us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483121.915371:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788483121.915391:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483121.915395:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483121.915432:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072437376:0@lo:400:kworker.0 00000100:00100000:0.0:1788483121.915461:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788483121.915467:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788483121.915470:0:3276:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788483121.915473:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072437504:0@lo:8:kworker.0 00010000:00080000:0.0:1788483121.915485:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb903111c00 x1875360072437248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788483131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483121.915493:0:3276:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788483121.915499:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788483121.915505:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788483121.915509:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788483121.915511:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb803317800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788483121.915515:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3276:1875360072437248:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788483121.915539:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb801ff7b80 x1875360072437760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483121.915547:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3277:1875360072437760:0@lo:400:kworker.0 00010000:00080000:0.0:1788483121.915555:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9eb801ff5180 x1875360072437632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483121.915563:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875360072437632:0@lo:400:kworker.0 00000040:00080000:0.0:1788483121.919115:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788483121.919197:0:15745:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788483121.919237:0:15745:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788483121.919272:0:15745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15a00/0x42820277aad79ddd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79de4 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483121.919285:0:15745:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93fe15a00/0x42820277aad79ddd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79de4 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788483121.919334:0:15745:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788483121.919337:0:15745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788483121.919338:0:15745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483121.919339:0:15745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483121.919341:0:15745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483121.919342:0:15745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483121.919344:0:15745:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483121.919348:0:15745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483121.919350:0:15745:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788483121.919355:0:15745:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788483121.919359:0:15745:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788483121.919360:0:15745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788483121.919361:0:15745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483121.919362:0:15745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483121.919363:0:15745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483121.919364:0:15745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483121.919366:0:15745:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483121.919367:0:15745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483121.919368:0:15745:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788483121.919400:0:15745:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788483121.919427:0:15745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072437888:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788483121.919525:0:15745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483121.919580:0:15745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9072d9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788483121.919608:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072437888 00000100:00100000:2.0:1788483121.919617:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072437888 00000100:00100000:2.0:1788483121.919681:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788483121.919693:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:15745:x1875360072437888:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788483121.919727:0:14339:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788483121.919747:0:14339:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788483121.975488:0:14339:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788483121.975511:0:14339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788483121.979992:0:14361:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788483121.980003:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788483121.980028:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.980050:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79cd3 expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.980059:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.980106:0:14361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad79cd3 expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.980121:0:14361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad79cd3 expref: 19 pid: 14340 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483121.980135:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903112300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14361:1875360072438016:0@lo:104: 00000100:00100000:3.0:1788483121.980207:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483121.980789:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072438016 00000100:00100000:2.0:1788483121.980799:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072438016 00000100:00100000:2.0:1788483121.980857:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483121.980868:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:14361:x1875360072438016:12345-0@lo:104: 00010000:00010000:2.0:1788483121.980881:0:14329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.980934:0:14329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788483121.980940:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:14361:x1875360072438016:12345-0@lo:104: Request processed in 74us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483121.980946:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788483121.980982:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483121.980987:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.980995:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627400 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:2.0:1788483121.980999:0:14334:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.981007:0:14334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788483121.981014:0:14334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788483121.981020:0:14334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788483121.981050:0:14334:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.981056:0:14334:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788483121.981074:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.981080:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f627400/0x42820277aad79cd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79cda expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483121.981095:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483121.981097:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483121.981099:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483121.981112:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3279:1875360072438144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788483121.981142:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483121.981650:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb910e3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788483121.981673:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903112300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14361:1875360072438016:0@lo:104: 00010000:00010000:3.0:1788483121.981692:0:14361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483121.983941:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072438144 00000100:00100000:3.0:1788483121.983956:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072438144 00010000:00010000:3.0:1788483121.983999:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79cd3 expref: 20 pid: 14340 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483121.984049:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483121.984058:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+20:3279:x1875360072438144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483121.984072:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483121.984077:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79cd3 expref: 20 pid: 14340 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984088:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad79cd3 expref: 20 pid: 14340 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984104:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93fe14a00/0x42820277aad79cda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad79cd3 expref: 20 pid: 14340 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984119:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984128:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788483121.984145:0:14330:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004189822s 00010000:00010000:3.0:1788483121.984150:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984157:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984182:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984190:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984197:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483121.984202:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984210:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984227:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984238:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483121.984333:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3279:x1875360072438144:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483121.984341:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788483121.984375:0:14361:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984383:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483121.984390:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93fe14600/0x42820277aad79e00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483121.984615:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92eb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3279:1875360072438144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483121.994118:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:15745:x1875360072437888:12345-0@lo:253:mount.lustre.0 Request processed in 74417us (74583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483121.994149:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788483121.994244:0:15745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:34a2d1d6-061f-4613-bc6f-7f9dfae33666:15745:1875360072437888:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788483121.994393:0:15745:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788483121.994398:0:15745:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788483121.994406:0:15745:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788483121.994408:0:15745:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788483121.994409:0:15745:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788483121.994410:0:15745:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788483121.994411:0:15745:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788483121.994413:0:15745:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788483121.994416:0:15745:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788483121.994417:0:15745:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788483121.994437:0:15745:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788483122.005576:0:15745:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788483122.005766:0:15745:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788483122.006172:0:15745:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788483122.006489:0:15745:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788483122.006645:0:15745:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788483122.006949:0:15745:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788483122.010399:0:15745:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788483122.092814:0:15745:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788483122.092825:0:15745:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788483122.092872:0:15745:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788483122.092974:0:15745:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788483122.093000:0:15745:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788483122.093038:0:15745:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788483122.739214:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788483123.701635:0:14342:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788483123.701643:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9eb92163b000 from 8 10000000:01000000:1.0:1788483123.701648:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788483123.701705:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3e00/0x42820277aad79e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483123.701719:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3e00/0x42820277aad79e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483123.701732:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3e00/0x42820277aad79e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483123.701761:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072438272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483123.701908:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483123.701963:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483123.702318:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072438272 00000100:00100000:0.0:1788483123.702327:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072438272 00000100:00100000:0.0:1788483123.702458:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788483123.702471:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:14342:x1875360072438272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483123.702486:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483123.702503:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907368e00/0x42820277aad79e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79e07 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483123.702529:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907368e00/0x42820277aad79e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79e07 expref: 19 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483123.702655:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907368e00/0x42820277aad79e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79e07 expref: 19 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483123.702664:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368e00, rc 0) 00000100:00100000:0.0:1788483123.702713:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:14342:x1875360072438272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483123.702720:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788483123.702911:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072438272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483123.702932:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3e00/0x42820277aad79e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79e0e expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483123.702941:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3e00/0x42820277aad79e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79e0e expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483123.703004:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072438400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788483123.703043:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483123.703091:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788483123.703481:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072438400 00000100:00100000:0.0:1788483123.703489:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072438400 00000100:00100000:0.0:1788483123.703527:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788483123.703914:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:14342:x1875360072438400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788483123.703940:0:14339:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788483123.703967:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788483123.703970:0:14339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788483123.704092:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:14342:x1875360072438400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483123.704100:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788483123.721660:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072438400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788483123.721741:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788483123.721752:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3e00/0x42820277aad79e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79e0e expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483123.721763:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3e00/0x42820277aad79e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79e0e expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483123.763888:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788483123.773003:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788483123.773030:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000100:00100000:2.0:1788483124.658639:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072438528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483124.658743:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483124.658888:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072438528 00000100:00100000:3.0:1788483124.658900:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072438528 00000100:00100000:3.0:1788483124.658983:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788483124.658996:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072438528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483124.659061:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788483124.661702:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483124.662644:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072438528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3641us (3890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483124.662662:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483124.664512:0:3280:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788483124.664576:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072438528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788483124.789219:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483125.811376:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788483126.324156:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788483126.834653:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788483127.218380:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788483127.218387:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788483127.218390:0:38:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788483127.218403:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9eb902d3e000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788483127.218425:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9eb801ff6a00 x1875360072438912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788483127.218504:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3277:1875360072438656:0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.218593:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483127.218649:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072439296:0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.218677:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483127.218703:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483127.218709:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072438784:0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.218734:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483127.218765:0:3276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072438912:0@lo:8:kworker.0 00000100:00100000:0.0:1788483127.218789:0:3276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483127.218815:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072439040:0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.218838:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483127.218855:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483127.218859:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb801ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072439168:0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.218879:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483127.218917:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072438656 00000100:00100000:0.0:1788483127.218924:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072438656 00000100:00100000:0.0:1788483127.218966:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788483127.218975:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92edc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3277:x1875360072438656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.219021:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92edc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3277:x1875360072438656:12345-0@lo:400:kworker.0 Request processed in 47us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483127.219027:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788483127.219058:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072439296 00000100:00100000:0.0:1788483127.219062:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072439296 00000100:00100000:0.0:1788483127.219093:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072439040 00000100:00100000:0.0:1788483127.219096:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072439040 00000100:00100000:0.0:1788483127.219106:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072439168 00000100:00100000:0.0:1788483127.219108:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072439168 00000100:00100000:0.0:1788483127.219120:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788483127.219126:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875360072439296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.219156:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875360072439296:12345-0@lo:400:kworker.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483127.219162:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788483127.219173:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483127.219180:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072439040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.219208:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072439040:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483127.219215:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788483127.219226:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483127.219232:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072439168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.219278:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072439168:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483127.219293:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483127.219311:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072438784 00000100:00100000:0.0:1788483127.219315:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072438784 00000100:00100000:0.0:1788483127.219339:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072438912 00000100:00100000:0.0:1788483127.219342:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072438912 00000100:00100000:0.0:1788483127.219358:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483127.219364:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072438784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.219394:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072438784:12345-0@lo:400:kworker.0 Request processed in 30us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483127.219400:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788483127.219411:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483127.219415:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3276:x1875360072438912:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788483127.219438:0:15028:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1788483127.219465:0:15028:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x42820277aad79e15 00002000:00100000:0.0:1788483127.219478:0:15028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9eb929355800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788483127.219482:0:15028:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788483127.219484:0:15028:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788483127.219855:0:15028:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788483127.219880:0:15028:0:(import.c:65:import_set_state_nolock()) ffff9eb929356000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483127.231411:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3276:x1875360072438912:12345-0@lo:8:kworker.0 Request processed in 11975us (12602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483127.231434:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788483127.231514:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483127.231522:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788483127.231602:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb801ff6a00 x1875360072438912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788483152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788483127.231648:0:3276:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788483127.231664:0:3276:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788483127.231671:0:3276:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788483127.231676:0:3276:0:(import.c:65:import_set_state_nolock()) ffff9eb902d3e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788483127.231690:0:3276:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788483127.231698:0:3276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3276:1875360072438912:0@lo:8:kworker.0 00010000:00080000:0.0:1788483127.231750:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb801ff5f80 x1875360072439168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483127.231761:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072439168:0@lo:400:kworker.0 00010000:00080000:0.0:1788483127.231775:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb801ff6680 x1875360072439040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483127.231783:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072439040:0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.231898:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072438784:0@lo:400:kworker.0 00000100:00100000:0.0:1788483127.231910:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3277:1875360072438656:0@lo:400:kworker.0 00010000:00080000:0.0:1788483127.231923:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb801ff4000 x1875360072439296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788483143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788483127.231932:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb801ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072439296:0@lo:400:kworker.0 00000004:00080000:3.0:1788483127.238955:0:14370:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788483127.239007:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14370:1875360072439552:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788483127.239108:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483127.239142:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbeb40 going to sleep for 11 seconds 00000004:00080000:3.0:1788483127.239164:0:14369:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788483127.239715:0:14369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444405464290ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788483127.240073:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072439424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788483127.240123:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483127.240186:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072439424 00000100:00100000:3.0:1788483127.240197:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072439424 00000100:00100000:3.0:1788483127.240293:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788483127.240302:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072439424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483127.240333:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788483127.240381:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875360072439424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483127.240389:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788483127.240421:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788483127.240451:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9eb903112300 x1875360072439424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788483143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788483127.240472:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072439424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483127.240617:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072439552 00000100:00100000:2.0:1788483127.240623:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072439552 00000100:00100000:2.0:1788483127.240669:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788483127.240678:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14370:x1875360072439552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788483127.243213:0:15031:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788483127.243226:0:15031:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788483127.243233:0:15031:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788483127.260957:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.260979:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261019:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.261024:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.261033:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261057:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261071:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261080:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261113:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483127.261750:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.261760:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261773:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.261777:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.261783:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261794:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261815:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261822:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.261846:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788483127.262333:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.262340:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262352:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.262355:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.262359:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262371:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262381:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262388:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262422:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788483127.262933:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.262939:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262949:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.262952:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.262957:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262967:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262974:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262981:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.262990:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788483127.264543:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.264562:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.264579:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.264595:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.264602:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.264706:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.264718:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.264726:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.264740:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788483127.265898:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.265911:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.265926:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.265931:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.265937:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.265950:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.265961:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.265979:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.265996:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788483127.267293:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.267306:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.267324:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.267329:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.267335:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.267348:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.267358:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.267367:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.267381:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1788483127.268034:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788483127.268047:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268061:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66c00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.268068:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268079:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268109:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268117:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d70b504/0x42820277aad79e1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268150:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788483127.268155:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268163:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.268166:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268186:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268198:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268206:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbbd5b5e/0x42820277aad79e23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268220:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788483127.268225:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268232:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.268235:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268244:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268303:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268311:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c189129/0x42820277aad79e2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268339:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788483127.268344:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268352:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66200 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.268356:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268365:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268375:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268384:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026c5e7fd/0x42820277aad79e31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268396:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788483127.268401:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268408:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.268411:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268430:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268441:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268450:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b40dabbc/0x42820277aad79e38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268465:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483127.268480:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.268488:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.269580:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269596:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269827:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269838:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069658551/0x42820277aad79e3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269878:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483127.269884:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269893:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.269898:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269907:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269918:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269926:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bbaeb0/0x42820277aad79e46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.269942:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.269946:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.269949:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.270464:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.270752:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.270847:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.270852:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.270860:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.270877:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.270888:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.270897:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.270959:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788483127.271321:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483127.271329:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.271341:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.271353:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.271363:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.271378:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.271386:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e8b56cb/0x42820277aad79e4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.271410:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.271413:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.271417:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.274200:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.274219:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.274243:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.274274:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.274282:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.274300:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.274328:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.274338:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.274372:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483127.276574:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.276590:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.278217:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.278228:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.278238:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.278282:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.278298:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.278308:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.278351:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788483127.281173:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.281185:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.281203:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.281207:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.281213:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.281226:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.281234:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.281240:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.281273:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788483127.282326:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788483127.282341:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282353:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c66a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.282357:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282369:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282390:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282405:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fbf57ae/0x42820277aad79e54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282433:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483127.282438:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282445:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.282448:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282458:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282471:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282476:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002feb0196/0x42820277aad79e5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282498:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483127.282502:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282509:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.282520:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282530:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282554:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282562:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6251dcb/0x42820277aad79e62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.282578:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.282580:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.282582:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.284343:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.284359:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.284380:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.284397:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.284406:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.284423:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.284434:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.284443:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.285207:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483127.287289:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.287306:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.287329:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.287335:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.287343:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287355:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483127.287362:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287373:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.287379:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287391:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492200 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483127.287400:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287410:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.287418:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483127.287428:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287461:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287470:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054d65a63/0x42820277aad79e69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287508:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483127.287513:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287519:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483127.287523:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287531:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287556:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287563:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f2458f2/0x42820277aad79e70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.287583:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.287586:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.287588:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.287597:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.287605:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.289067:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.289081:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.289111:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.289116:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.289124:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.289137:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.289163:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.289173:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.289209:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483127.289988:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.289997:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.290018:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.290022:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.290029:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.290041:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.290051:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.290059:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.290096:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788483127.290867:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788483127.290889:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.290907:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483127.290913:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.290926:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.290956:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.290964:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074e61e37/0x42820277aad79e77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.291005:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483127.291009:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.291014:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.291032:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483127.291037:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.291044:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.291056:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.291062:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d619ba0/0x42820277aad79e7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.291079:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.291081:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.291083:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.296333:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.296347:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.296366:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.296371:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.296377:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.296391:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.296410:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.296419:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.296456:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483127.297209:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483127.297314:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.297328:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483127.297333:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.297343:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.297378:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.297385:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a077aba6/0x42820277aad79e85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.297409:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.297411:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.297413:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.304068:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.304090:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304112:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.304117:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.304126:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304143:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304158:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304169:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304214:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483127.304232:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483127.304240:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304275:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493000 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483127.304281:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304293:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304318:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304328:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026d345d6/0x42820277aad79e8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.304356:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.304359:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.304361:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.307960:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.307978:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.308001:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.308017:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.308027:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.308046:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.308059:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.308069:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.308096:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483127.311207:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.311230:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.311273:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.311279:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.311287:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.311309:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311316:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483127.311323:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311337:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.311350:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311382:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483127.311391:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.311399:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483127.311407:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311440:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311450:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edbade0f/0x42820277aad79e93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311510:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483127.311514:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311523:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483127.311526:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311550:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311563:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311571:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067587042/0x42820277aad79e9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.311591:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.311593:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.311595:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483127.311895:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.313427:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.313441:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.313462:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.313482:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.313490:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.313507:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.313519:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.313528:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.313562:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483127.313581:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000001:00100000:0.0:1788483127.313587:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788483127.313589:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.314230:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483127.314238:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.314592:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.314680:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.314689:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a570f2/0x42820277aad79ea1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.314724:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.314728:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.314731:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.316445:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.316458:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.316491:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.316497:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.316504:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.316519:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.316550:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.316559:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.316586:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483127.316652:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483127.316669:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.316684:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483127.316718:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.316733:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.316758:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.316767:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce97aa5c/0x42820277aad79ea8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.316792:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.316794:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.316796:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.318129:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.318145:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.318162:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.318167:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.318174:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.318188:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.318198:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.318207:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.318304:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788483127.319058:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.319066:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319080:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.319084:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.319090:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319101:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319109:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319118:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319144:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788483127.319163:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788483127.319171:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319181:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901492800 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483127.319197:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319208:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319233:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319242:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079a6f398/0x42820277aad79eaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319312:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483127.319317:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319324:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb901493400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483127.319329:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319337:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319348:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319358:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f7c3d0/0x42820277aad79eb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.319387:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.319389:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.319391:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.320297:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.320307:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.320320:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.320324:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.320330:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.320341:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.320352:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.320361:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.320393:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788483127.320804:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788483127.320819:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483127.320835:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781600 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483127.320841:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483127.320853:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483127.320885:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483127.320893:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d630e9ce/0x42820277aad79ebd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483127.320946:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483127.320951:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788483127.320954:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.321104:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.321112:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321134:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.321138:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.321143:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321154:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321162:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321169:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321193:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483127.321208:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483127.321213:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321221:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780e00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483127.321225:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321233:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321291:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321299:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3bb1f8/0x42820277aad79ec4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.321316:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.321318:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.321320:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.321712:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.323112:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.323132:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.323156:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.323161:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.323169:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.323186:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.323199:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.323207:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.323307:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483127.323314:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788483127.323328:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.323346:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780a00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483127.323352:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.323364:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.323390:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.323411:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051cd1abb/0x42820277aad79ecb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483127.323455:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.323457:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483127.323463:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788483127.325143:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.325159:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325179:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.325184:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.325192:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325208:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325221:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325230:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325287:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788483127.325305:0:15618:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788483127.325312:0:15618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325322:0:15618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781200 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483127.325337:0:15618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325347:0:15618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325380:0:15618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325389:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fabec7ff/0x42820277aad79ed2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.325414:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.325416:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483127.325417:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788483127.326902:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788483127.327684:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788483127.327699:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.327722:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788483127.327728:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483127.327735:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.327750:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.327833:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.327849:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483127.327881:0:15031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788483127.328135:0:15031:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788483127.328323:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14370:x1875360072439552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 87638us (89205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483127.328336:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483127.328498:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14370:1875360072439552:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788483127.328522:0:14370:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788483127.329948:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14370:1875360072439680:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788483127.330049:0:14370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483127.330223:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483127.330311:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072439680 00000100:00100000:2.0:1788483127.330323:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072439680 00000100:00100000:2.0:1788483127.330397:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483127.330417:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14370:x1875360072439680:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788483127.331048:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483127.331063:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.331081:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:3.0:1788483127.331540:0:14333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.331557:0:14333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.331899:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.331911:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000848e2d65/0x42820277aad79ed9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483127.331958:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.331961:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483127.331963:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788483127.332053:0:15030:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1788483127.343569:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14370:x1875360072439680:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13148us (13512us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788483127.343582:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788483127.343672:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14370:1875360072439680:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788483127.343693:0:14370:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788483127.859455:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788483128.487070:0:16101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788483128.886063:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483129.784212:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072439808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483129.784340:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483129.784478:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072439808 00000100:00100000:3.0:1788483129.784498:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072439808 00000100:00100000:3.0:1788483129.784622:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788483129.784632:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072439808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788483129.785158:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788483129.785412:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788483129.787210:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072439808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2565us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483129.787224:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788483129.787229:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072439808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788483129.906504:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483130.676879:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.676977:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064054016 00000100:00100000:0.0:1788483130.676992:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064054016 00000100:00100000:0.0:1788483130.677187:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1788483130.677198:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2350:x1875360064054016:12345-192.168.201.6@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788483130.677280:0:14338:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a73dd3dc-49a8-4977-a14c-11d5aaad0a61@192.168.201.6@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1788483130.677319:0:14338:0:(genops.c:1385:class_connect()) connect: client a73dd3dc-49a8-4977-a14c-11d5aaad0a61, cookie 0x42820277aad79ee0 00000100:00080000:0.0:1788483130.677536:0:14338:0:(import.c:65:import_set_state_nolock()) ffff9eb929357000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483130.677625:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+5:2350:x1875360064054016:12345-192.168.201.6@tcp:250:mount.lustre.0 Request processed in 427us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.677634:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 74 00000100:00100000:0.0:1788483130.687703:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483130.687773:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064054144 00000100:00100000:2.0:1788483130.687786:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064054144 00000100:00100000:2.0:1788483130.687899:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:2.0:1788483130.687911:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+5:13747:x1875360064054144:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788483130.687939:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483130.687966:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f781800/0x42820277aad79ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077da3 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483130.688001:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f781800/0x42820277aad79ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077da3 expref: 6 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483130.688029:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f781800/0x42820277aad79ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077da3 expref: 6 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483130.688038:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781800, rc 0) 00000100:00100000:2.0:1788483130.688110:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+6:13747:x1875360064054144:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 202us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483130.688116:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 75 00000100:00100000:2.0:1788483130.691953:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.692021:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064054272 00000100:00100000:0.0:1788483130.692032:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064054272 00000100:00100000:0.0:1788483130.692139:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:0.0:1788483130.692148:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+6:13747:x1875360064054272:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788483130.692509:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+6:13747:x1875360064054272:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 360us (566us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788483130.692518:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 76 00000100:00100000:3.0:1788483130.698388:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483130.698612:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064054400 00000100:00100000:2.0:1788483130.698625:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064054400 00000100:00100000:2.0:1788483130.698685:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:2.0:1788483130.698696:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+6:13747:x1875360064054400:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788483130.698720:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483130.698744:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f781a00/0x42820277aad79eee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077daa expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483130.698778:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f781a00/0x42820277aad79eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077daa expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483130.698796:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f781a00/0x42820277aad79eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077daa expref: 7 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483130.698806:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781a00, rc 0) 00000100:00100000:2.0:1788483130.698868:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+7:13747:x1875360064054400:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 174us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483130.698876:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 77 00000100:00100000:3.0:1788483130.700027:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.700086:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064054528 00000100:00100000:0.0:1788483130.700095:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064054528 00000100:00100000:0.0:1788483130.700145:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:0.0:1788483130.700156:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+7:13747:x1875360064054528:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788483130.700504:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+8:13747:x1875360064054528:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 348us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.700513:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 78 00000100:00100000:1.0:1788483130.701726:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483130.701840:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064054656 00000100:00100000:2.0:1788483130.701850:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064054656 00000100:00100000:2.0:1788483130.701902:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:2.0:1788483130.701914:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+8:13747:x1875360064054656:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788483130.702456:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+8:13747:x1875360064054656:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 543us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483130.702467:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 79 00000100:00100000:3.0:1788483130.704984:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.705051:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064054784 00000100:00100000:0.0:1788483130.705064:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064054784 00000100:00100000:0.0:1788483130.705136:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:0.0:1788483130.705149:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+8:13765:x1875360064054784:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483130.705625:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+8:13765:x1875360064054784:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 474us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.705635:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 80 00000100:00100000:3.0:1788483130.722961:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483130.723063:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064054912 00000100:00100000:2.0:1788483130.723091:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064054912 00000100:00100000:2.0:1788483130.723167:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:2.0:1788483130.723182:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+8:13765:x1875360064054912:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788483130.724289:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+8:13765:x1875360064054912:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 1100us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483130.724302:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 81 00000100:00100000:2.0:1788483130.732969:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483130.734308:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064055040 00000100:00100000:1.0:1788483130.734327:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064055040 00000100:00100000:1.0:1788483130.734406:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:1.0:1788483130.734420:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+8:13747:x1875360064055040:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483130.734445:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483130.734471:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d3800/0x42820277aad79ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077dd4 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483130.734522:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d3800/0x42820277aad79ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077dd4 expref: 9 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483130.734545:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d3800/0x42820277aad79ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077dd4 expref: 9 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483130.734556:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d3800, rc 0) 00000100:00100000:1.0:1788483130.734637:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+9:13747:x1875360064055040:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 220us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483130.734663:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 82 00000100:00100000:1.0:1788483130.738025:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483130.740943:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064055168 00000100:00100000:3.0:1788483130.740970:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064055168 00000100:00100000:3.0:1788483130.741159:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:3.0:1788483130.741175:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+9:13747:x1875360064055168:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788483130.741225:0:14339:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788483130.741285:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788483130.741291:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788483130.741295:0:14339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788483130.741298:0:14339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788483130.748514:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+9:13747:x1875360064055168:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 6978us (10140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483130.748752:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 83 00000100:00100000:0.0:1788483130.752008:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483130.752100:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064055296 00000100:00100000:1.0:1788483130.752114:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064055296 00000100:00100000:1.0:1788483130.752178:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:1.0:1788483130.752192:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+9:13747:x1875360064055296:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483130.752216:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483130.752241:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ddb expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483130.752308:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483130.752321:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483130.752329:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d2800, rc 0) 00000100:00100000:1.0:1788483130.752395:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13747:x1875360064055296:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483130.752403:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 84 00000100:00100000:3.0:1788483130.754380:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.754467:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064055424 00000100:00100000:0.0:1788483130.754490:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064055424 00000100:00100000:0.0:1788483130.754559:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:0.0:1788483130.754570:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13747:x1875360064055424:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788483130.755536:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13747:x1875360064055424:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 950us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.755561:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 85 00000100:00100000:3.0:1788483130.758461:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.758867:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064055552 00000100:00100000:0.0:1788483130.758883:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064055552 00000100:00100000:0.0:1788483130.759021:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:0.0:1788483130.759036:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13747:x1875360064055552:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788483130.760037:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13747:x1875360064055552:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 998us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.760051:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 86 00000100:00100000:2.0:1788483130.765736:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.766204:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064055680 00000100:00100000:0.0:1788483130.767073:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064055680 00000100:00100000:0.0:1788483130.767382:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:0.0:1788483130.767397:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13767:x1875360064055680:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788483130.770343:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f61c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13767:x1875360064055680:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 2936us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.770359:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 87 00000100:00100000:0.0:1788483130.781060:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483130.781536:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064055808 00000100:00100000:1.0:1788483130.781551:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064055808 00000100:00100000:1.0:1788483130.781634:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:1.0:1788483130.781649:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13767:x1875360064055808:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483130.782005:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13767:x1875360064055808:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 359us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483130.782025:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 88 00000100:00100000:3.0:1788483130.793854:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.794453:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064055936 00000100:00100000:0.0:1788483130.794482:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064055936 00000100:00100000:0.0:1788483130.794569:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1788483130.794581:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1875360064055936:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788483130.794620:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d@192.168.201.6@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1788483130.794692:0:14347:0:(genops.c:1385:class_connect()) connect: client 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d, cookie 0x42820277aad79f03 00000004:00100000:0.0:1788483130.794746:0:14347:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:0.0:1788483130.794754:0:14347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788483130.857500:0:14347:0:(import.c:65:import_set_state_nolock()) ffff9eb929352000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483130.858025:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2350:x1875360064055936:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 63158us (63968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.858041:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:3.0:1788483130.861669:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483130.861935:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064056064 00000100:00100000:0.0:1788483130.861948:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064056064 00000100:00100000:0.0:1788483130.862038:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1788483130.862050:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:0:x1875360064056064:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788483130.862107:0:14346:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788483130.862220:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:0:x1875360064056064:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 171us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.862228:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00080000:2.0:1788483130.862483:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483130.862963:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483130.863032:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064056192 00000100:00100000:1.0:1788483130.863040:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064056192 00000100:00100000:1.0:1788483130.863086:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788483130.863097:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13747:x1875360064056192:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788483130.863117:0:14347:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788483130.863162:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13747:x1875360064056192:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483130.863170:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1788483130.866669:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483130.866824:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064056320 00000100:00100000:1.0:1788483130.866840:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064056320 00000100:00100000:1.0:1788483130.866959:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788483130.866973:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13747:x1875360064056320:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788483130.867105:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13747:x1875360064056320:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 134us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483130.867114:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788483130.869364:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483130.869411:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483130.869446:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483130.869566:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064056704 00000100:00100000:2.0:1788483130.869579:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064056704 00000100:00100000:2.0:1788483130.869637:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788483130.869650:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13747:x1875360064056704:12345-192.168.201.6@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788483130.870158:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064056448 00000100:00100000:0.0:1788483130.870163:0:15620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064056448 00000100:00100000:0.0:1788483130.870199:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064056576 00000100:00100000:0.0:1788483130.870202:0:15620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064056576 00000100:00100000:0.0:1788483130.870230:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:0.0:1788483130.870237:0:15620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875360064056448:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788483130.870298:0:15620:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d@192.168.201.6@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1788483130.870347:0:15620:0:(genops.c:1385:class_connect()) connect: client 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d, cookie 0x42820277aad79f0a 00002000:00100000:0.0:1788483130.870363:0:15620:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d/ffff9eb801d0c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788483130.870395:0:15620:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000004:00080000:2.0:1788483130.870678:0:14348:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 925us 00000100:00100000:1.0:1788483130.870758:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1788483130.870767:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875360064056576:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788483130.870786:0:15031:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d@192.168.201.6@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1788483130.870809:0:15031:0:(genops.c:1385:class_connect()) connect: client 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d, cookie 0x42820277aad79f11 00002000:00100000:1.0:1788483130.870815:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d/ffff9eb802cad000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788483130.870846:0:15031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788483130.871075:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788483130.871120:0:15031:0:(import.c:65:import_set_state_nolock()) ffff9eb802ca8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483130.871215:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2350:x1875360064056576:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 447us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483130.871224:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00002000:00080000:0.0:1788483130.875939:0:15620:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788483130.876001:0:15620:0:(import.c:65:import_set_state_nolock()) ffff9eb801d08800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788483130.876101:0:15620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2350:x1875360064056448:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 5860us (6685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483130.876490:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000004:00200000:3.0:1788483130.894894:0:14348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788483130.895115:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13747:x1875360064056704:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 25459us (25754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483130.895133:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00010000:00010000:2.0:1788483130.930595:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483131.108656:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483131.108747:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064056832 00000100:00100000:2.0:1788483131.108764:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064056832 00000100:00100000:2.0:1788483131.108920:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1788483131.108959:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13788:x1875360064056832:12345-192.168.201.6@tcp:101:mkdir.0 00010000:00010000:2.0:1788483131.108991:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483131.109031:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781e00/0x42820277aad79f18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e05 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483131.109148:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad79f1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483131.109181:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad79f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483131.109202:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad79f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483131.109641:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788483131.109648:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483131.109783:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad79f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483131.109826:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781e00/0x42820277aad79f18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e05 expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483131.109849:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad79f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e05 expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483131.109861:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:2.0:1788483131.109864:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788483131.109869:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780800, rc 0) 00000100:00100000:2.0:1788483131.109966:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:13788:x1875360064056832:12345-192.168.201.6@tcp:101:mkdir.0 Request processed in 1012us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483131.109984:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:2.0:1788483131.954738:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483132.338932:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483132.338970:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072439936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788483132.339090:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483132.339228:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072439936 00000100:00100000:0.0:1788483132.339239:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072439936 00000100:00100000:0.0:1788483132.339347:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788483132.339495:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3277:1875360072440064:0@lo:400:kworker.0 00000100:00080000:1.0:1788483132.339520:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483132.339543:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072440320:0@lo:400:kworker.0 00000100:00100000:2.0:1788483132.339558:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483132.339586:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483132.339606:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072440576:0@lo:400:kworker.0 00000100:00100000:1.0:1788483132.339615:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788483132.339630:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072440448:0@lo:400:kworker.0 00000100:00100000:2.0:1788483132.339647:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483132.339667:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483132.339670:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483132.339679:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072440192:0@lo:400:kworker.0 00000100:00100000:1.0:1788483132.339706:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072440320 00000100:00100000:1.0:1788483132.339712:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072440320 00000100:00100000:2.0:1788483132.339713:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483132.339745:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072440576 00000100:00100000:2.0:1788483132.339752:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072440448 00000100:00100000:2.0:1788483132.339757:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072440448 00000100:00100000:2.0:1788483132.339790:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788483132.339798:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072440320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483132.339835:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072439936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483132.339862:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788483132.339892:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875360072440320:12345-0@lo:400:kworker.0 Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483132.339901:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483132.339914:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875360072439936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 555us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483132.339924:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483132.339932:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072440448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483132.339940:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072440576 00000100:00100000:2.0:1788483132.339969:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072440448:12345-0@lo:400:kworker.0 Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483132.339970:0:14345:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788483132.339980:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788483132.339984:0:14345:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788483132.339999:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483132.340007:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875360072440576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483132.340040:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875360072440576:12345-0@lo:400:kworker.0 Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483132.340114:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072440192 00000100:00100000:1.0:1788483132.340118:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072440192 00000100:00100000:1.0:1788483132.340151:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788483132.340158:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072440192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483132.340177:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788483132.340199:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072440192:12345-0@lo:400:kworker.0 Request processed in 41us (485us total) trans 0 rc 0/0 00000100:00080000:2.0:1788483132.340201:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788483132.340208:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483132.340212:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788483132.340277:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072440192:0@lo:400:kworker.0 00000100:00100000:2.0:1788483132.340295:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072440576:0@lo:400:kworker.0 00000100:00100000:2.0:1788483132.340339:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072440448:0@lo:400:kworker.0 00000100:00100000:2.0:1788483132.340351:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875360072440320:0@lo:400:kworker.0 00000100:00100000:2.0:1788483132.340378:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072439936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483132.340483:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072440064 00000100:00100000:1.0:1788483132.340488:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072440064 00000100:00100000:1.0:1788483132.340523:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788483132.340530:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3277:x1875360072440064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483132.340572:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3277:x1875360072440064:12345-0@lo:400:kworker.0 Request processed in 41us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483132.340586:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788483132.340814:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3277:1875360072440064:0@lo:400:kworker.0 00000100:00100000:0.0:1788483132.345057:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:00100000:3.0:1788483132.512738:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d 00000001:00080000:3.0:1788483132.512767:0:7620:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788483132.980744:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483132.999910:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483133.000240:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064056960 00000100:00100000:2.0:1788483133.000287:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064056960 00000100:00100000:2.0:1788483133.000394:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788483133.000409:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:13840:x1875360064056960:12345-192.168.201.6@tcp:41:lfs.0 00000004:00000024:2.0:1788483133.000483:0:14346:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788483133.000624:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:13840:x1875360064056960:12345-192.168.201.6@tcp:41:lfs.0 Request processed in 218us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483133.000634:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:1.0:1788483133.001331:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483133.003872:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483133.004309:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064057088 00000100:00100000:0.0:1788483133.004323:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064057088 00000100:00100000:0.0:1788483133.004408:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1788483133.004420:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13840:x1875360064057088:12345-192.168.201.6@tcp:13:lfs.0 00002000:00000024:0.0:1788483133.004484:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483133.004606:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:13840:x1875360064057088:12345-192.168.201.6@tcp:13:lfs.0 Request processed in 187us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483133.004615:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00080000:2.0:1788483133.005523:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483133.007229:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483133.007351:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064057216 00000100:00100000:3.0:1788483133.007365:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064057216 00000100:00100000:3.0:1788483133.007455:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1788483133.007468:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:13840:x1875360064057216:12345-192.168.201.6@tcp:13:lfs.0 00002000:00000024:3.0:1788483133.007516:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788483133.007816:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483133.007942:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:13840:x1875360064057216:12345-192.168.201.6@tcp:13:lfs.0 Request processed in 476us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483133.007951:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:0.0:1788483133.178756:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483133.179568:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064057344 00000100:00100000:2.0:1788483133.179585:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064057344 00000100:00100000:2.0:1788483133.179675:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:2.0:1788483133.179689:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+10:13872:x1875360064057344:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788483133.179734:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483133.179762:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f781e00/0x42820277aad79f26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e0c expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483133.179805:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f781e00/0x42820277aad79f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e0c expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483133.179821:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f781e00/0x42820277aad79f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e0c expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483133.179833:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781e00, rc 0) 00000100:00100000:2.0:1788483133.179917:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13872:x1875360064057344:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 231us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483133.179925:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 90 00000100:00100000:0.0:1788483133.215896:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.216015:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064057472 00000100:00100000:1.0:1788483133.216030:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064057472 00000100:00100000:1.0:1788483133.216113:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:1.0:1788483133.216126:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13872:x1875360064057472:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788483133.216655:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13872:x1875360064057472:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 530us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.216667:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 91 00000100:00100000:0.0:1788483133.226789:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483133.226958:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064057600 00000100:00100000:2.0:1788483133.226973:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064057600 00000100:00100000:2.0:1788483133.227058:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:2.0:1788483133.227073:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13872:x1875360064057600:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788483133.227550:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13872:x1875360064057600:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 480us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483133.227562:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 92 00000100:00100000:0.0:1788483133.237643:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483133.238365:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064057728 00000100:00100000:2.0:1788483133.238382:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064057728 00000100:00100000:2.0:1788483133.238489:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:2.0:1788483133.238506:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13880:x1875360064057728:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788483133.239099:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13880:x1875360064057728:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 593us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483133.239120:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 93 00000100:00100000:0.0:1788483133.259707:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.259877:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064057856 00000100:00100000:1.0:1788483133.259895:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064057856 00000100:00100000:1.0:1788483133.259995:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:1.0:1788483133.260008:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13880:x1875360064057856:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483133.260462:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13880:x1875360064057856:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 455us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.260472:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 94 00000100:00100000:0.0:1788483133.262877:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.263443:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064057984 00000100:00100000:1.0:1788483133.263461:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064057984 00000100:00100000:1.0:1788483133.263553:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:1.0:1788483133.263567:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13872:x1875360064057984:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483133.263591:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483133.263619:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d2600/0x42820277aad79f2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e36 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.263669:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d2600/0x42820277aad79f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e36 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.263700:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d2600/0x42820277aad79f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e36 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.263712:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d2600, rc 0) 00000100:00100000:1.0:1788483133.269302:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13872:x1875360064057984:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 5718us (6421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.269321:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 95 00000100:00100000:0.0:1788483133.275307:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483133.275447:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064058112 00000100:00100000:2.0:1788483133.275464:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064058112 00000100:00100000:2.0:1788483133.275549:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:2.0:1788483133.275563:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13872:x1875360064058112:12345-192.168.201.6@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788483133.275601:0:14338:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788483133.275636:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788483133.275641:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788483133.275644:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788483133.275646:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788483133.277586:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13872:x1875360064058112:12345-192.168.201.6@tcp:256:mount.lustre.0 Request processed in 2009us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483133.277603:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 96 00000100:00100000:3.0:1788483133.285245:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.285529:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064058240 00000100:00100000:1.0:1788483133.285544:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064058240 00000100:00100000:1.0:1788483133.285618:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:1.0:1788483133.285631:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13872:x1875360064058240:12345-192.168.201.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788483133.285665:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483133.285692:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e3d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.285734:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 13 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.285748:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 13 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.285762:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d2e00, rc 0) 00000100:00100000:1.0:1788483133.285842:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13872:x1875360064058240:12345-192.168.201.6@tcp:101:mount.lustre.0 Request processed in 214us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.285850:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 97 00000100:00100000:0.0:1788483133.288383:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483133.288757:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064058368 00000100:00100000:2.0:1788483133.288772:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064058368 00000100:00100000:2.0:1788483133.288841:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:2.0:1788483133.288854:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13872:x1875360064058368:12345-192.168.201.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788483133.290467:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13872:x1875360064058368:12345-192.168.201.6@tcp:501:mount.lustre.0 Request processed in 1602us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483133.290482:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 98 00000100:00100000:3.0:1788483133.304520:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483133.304608:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064058496 00000100:00100000:0.0:1788483133.304623:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064058496 00000100:00100000:0.0:1788483133.304696:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:0.0:1788483133.304707:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13872:x1875360064058496:12345-192.168.201.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788483133.305164:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13872:x1875360064058496:12345-192.168.201.6@tcp:503:mount.lustre.0 Request processed in 456us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483133.305174:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 99 00000100:00100000:3.0:1788483133.307662:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.307926:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064058624 00000100:00100000:1.0:1788483133.307962:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064058624 00000100:00100000:1.0:1788483133.308037:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:1.0:1788483133.308050:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13882:x1875360064058624:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788483133.308495:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13882:x1875360064058624:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 446us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.308504:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 100 00000100:00100000:1.0:1788483133.314213:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483133.314449:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064058752 00000100:00100000:2.0:1788483133.314464:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064058752 00000100:00100000:2.0:1788483133.314541:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:2.0:1788483133.314555:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13882:x1875360064058752:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788483133.314887:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13882:x1875360064058752:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 333us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483133.314902:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 101 00000100:00100000:3.0:1788483133.327593:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.327755:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064058880 00000100:00100000:1.0:1788483133.327775:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064058880 00000100:00100000:1.0:1788483133.327853:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1788483133.327866:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1875360064058880:12345-192.168.201.6@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788483133.327906:0:16217:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 49d72f1d-b874-4119-991a-de07c355679e@192.168.201.6@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1788483133.327971:0:16217:0:(genops.c:1385:class_connect()) connect: client 49d72f1d-b874-4119-991a-de07c355679e, cookie 0x42820277aad79f3b 00000004:00100000:1.0:1788483133.328013:0:16217:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:1.0:1788483133.328175:0:16217:0:(import.c:65:import_set_state_nolock()) ffff9eb93aad2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483133.328314:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+6:2350:x1875360064058880:12345-192.168.201.6@tcp:38:mount.lustre.0 Request processed in 449us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.328325:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:2.0:1788483133.348735:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483133.348929:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064059136 00000100:00100000:0.0:1788483133.348954:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064059136 00000100:00100000:0.0:1788483133.349069:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788483133.349083:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:13872:x1875360064059136:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788483133.349128:0:14346:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788483133.349240:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:13872:x1875360064059136:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 160us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483133.349553:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00080000:2.0:1788483133.349971:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788483133.352417:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.353004:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064059264 00000100:00100000:1.0:1788483133.353019:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064059264 00000100:00100000:1.0:1788483133.353107:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:1.0:1788483133.353121:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+6:13872:x1875360064059264:12345-192.168.201.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788483133.353973:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+6:13872:x1875360064059264:12345-192.168.201.6@tcp:40:mount.lustre.0 Request processed in 129us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.353989:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1788483133.354142:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.354781:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064059008 00000100:00100000:1.0:1788483133.354793:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064059008 00000100:00100000:1.0:1788483133.354843:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1788483133.354855:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:0:x1875360064059008:12345-192.168.201.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788483133.354886:0:14346:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788483133.354967:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:0:x1875360064059008:12345-192.168.201.6@tcp:41:mount.lustre.0 Request processed in 114us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.354975:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:2.0:1788483133.361456:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483133.361604:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064059648 00000100:00100000:2.0:1788483133.361613:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483133.361620:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064059648 00000100:00100000:3.0:1788483133.361705:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788483133.361719:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49d72f1d-b874-4119-991a-de07c355679e+6:13872:x1875360064059648:12345-192.168.201.6@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788483133.361769:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000004:00200000:1.0:1788483133.362295:0:14349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788483133.362514:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49d72f1d-b874-4119-991a-de07c355679e+6:13872:x1875360064059648:12345-192.168.201.6@tcp:33:mount.lustre.0 Request processed in 795us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.362539:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1788483133.364736:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064059392 00000100:00100000:0.0:1788483133.364759:0:15620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064059392 00000100:00100000:1.0:1788483133.364826:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064059520 00000100:00100000:1.0:1788483133.364832:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064059520 00000100:00100000:1.0:1788483133.364878:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1788483133.364889:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875360064059392:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788483133.364932:0:15030:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 49d72f1d-b874-4119-991a-de07c355679e@192.168.201.6@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1788483133.364987:0:15030:0:(genops.c:1385:class_connect()) connect: client 49d72f1d-b874-4119-991a-de07c355679e, cookie 0x42820277aad79f42 00002000:00100000:1.0:1788483133.365003:0:15030:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 49d72f1d-b874-4119-991a-de07c355679e/ffff9eb93aad5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788483133.365018:0:15030:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788483133.365446:0:15030:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788483133.365487:0:15030:0:(import.c:65:import_set_state_nolock()) ffff9eb93aad7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788483133.365803:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1788483133.365814:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875360064059520:12345-192.168.201.6@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788483133.365840:0:15031:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 49d72f1d-b874-4119-991a-de07c355679e@192.168.201.6@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1788483133.365870:0:15031:0:(genops.c:1385:class_connect()) connect: client 49d72f1d-b874-4119-991a-de07c355679e, cookie 0x42820277aad79f49 00002000:00100000:2.0:1788483133.365878:0:15031:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49d72f1d-b874-4119-991a-de07c355679e/ffff9eb801d18000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788483133.365887:0:15031:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1788483133.366141:0:15031:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788483133.366172:0:15031:0:(import.c:65:import_set_state_nolock()) ffff9eb801d1c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788483133.366222:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49d72f1d-b874-4119-991a-de07c355679e+6:2350:x1875360064059392:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 1333us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.366232:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:2.0:1788483133.367061:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49d72f1d-b874-4119-991a-de07c355679e+6:2350:x1875360064059520:12345-192.168.201.6@tcp:8:mount.lustre.0 Request processed in 1240us (5286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483133.367071:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:3.0:1788483133.548450:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483133.549680:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064059776 00000100:00100000:1.0:1788483133.549726:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064059776 00000100:00100000:1.0:1788483133.549827:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:1.0:1788483133.549841:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+6:13903:x1875360064059776:12345-192.168.201.6@tcp:101:mkdir.0 00010000:00010000:1.0:1788483133.549871:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483133.549902:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3400/0x42820277aad79f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e67 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.549997:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.550014:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.550041:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483133.550783:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788483133.550793:0:16217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788483133.550911:0:16217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.550963:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3400/0x42820277aad79f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 8 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.550990:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 7 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483133.551002:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:1.0:1788483133.551005:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483133.551011:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d3600, rc 0) 00000100:00100000:1.0:1788483133.551246:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+7:13903:x1875360064059776:12345-192.168.201.6@tcp:101:mkdir.0 Request processed in 1406us (2826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483133.551307:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000001:00100000:2.0:1788483133.963747:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d 00000001:00100000:2.0:1788483133.963772:0:6686:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49d72f1d-b874-4119-991a-de07c355679e 00010000:00010000:2.0:1788483134.002787:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483134.909171:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072440704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788483134.909313:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483134.909478:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072440704 00000100:00100000:0.0:1788483134.909490:0:15033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072440704 00000100:00100000:0.0:1788483134.909574:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788483134.909586:0:15033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072440704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483134.909635:0:15033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788483134.909751:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483134.917564:0:15033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072440704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7965us (8237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483134.917607:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788483134.924674:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072440704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788483135.027290:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788483135.963701:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4f2cdc27-59e6-4887-b2f8-9564a19cdd8d 00000001:00100000:2.0:1788483135.963722:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49d72f1d-b874-4119-991a-de07c355679e 00010000:00010000:3.0:1788483136.054669:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788483136.504387:0:16307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1788483136.563792:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788483137.074606:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483137.458693:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3279:1875360072440960:0@lo:400:kworker.0 00000100:00100000:0.0:1788483137.458813:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483137.459078:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072441216:0@lo:400:kworker.0 00000100:00100000:2.0:1788483137.459168:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483137.459210:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788483137.459217:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072441088:0@lo:400:kworker.0 00000100:00100000:2.0:1788483137.459288:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483137.459684:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072441216 00000100:00100000:2.0:1788483137.459695:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072441216 00000100:00100000:2.0:1788483137.459748:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072441088 00000100:00100000:2.0:1788483137.459750:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072441088 00000100:00100000:2.0:1788483137.459769:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483137.459777:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072441216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483137.459827:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072441216:12345-0@lo:400:kworker.0 Request processed in 51us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483137.459834:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788483137.459849:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788483137.459854:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92eb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072441088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483137.459874:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92eb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072441088:12345-0@lo:400:kworker.0 Request processed in 21us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483137.459879:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788483137.459922:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072441088:0@lo:400:kworker.0 00000100:00100000:2.0:1788483137.459932:0:3278:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788483137.460450:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072441216:0@lo:400:kworker.0 00000100:00080000:1.0:1788483137.464557:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483137.464569:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483137.465129:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072440832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483137.465229:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483137.465309:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483137.465317:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072441344:0@lo:400:kworker.0 00000100:00100000:1.0:1788483137.465344:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483137.465394:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072440960 00000100:00100000:1.0:1788483137.465402:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072440960 00000100:00100000:1.0:1788483137.465449:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788483137.465458:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3279:x1875360072440960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483137.465506:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937e22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3279:x1875360072440960:12345-0@lo:400:kworker.0 Request processed in 49us (6695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483137.465516:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788483137.465574:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072440832 00000100:00100000:1.0:1788483137.465582:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072440832 00000100:00100000:1.0:1788483137.465651:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483137.465665:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072440832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788483137.465707:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788483137.465762:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072440832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483137.465772:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788483137.465835:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072440832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483137.465906:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072441344 00000100:00100000:1.0:1788483137.465910:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072441344 00000100:00100000:1.0:1788483137.465941:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788483137.465948:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072441344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483137.465981:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072441344:12345-0@lo:400:kworker.0 Request processed in 35us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483137.465987:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788483137.466009:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072441344:0@lo:400:kworker.0 00000100:00100000:0.0:1788483137.466339:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3279:1875360072440960:0@lo:400:kworker.0 00000100:00100000:0.0:1788483137.469178:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483137.469300:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072441472:0@lo:400:kworker.0 00000100:00100000:0.0:1788483137.469408:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483137.469535:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072441600:0@lo:400:kworker.0 00000100:00100000:1.0:1788483137.470055:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072441472 00000100:00100000:1.0:1788483137.470067:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072441472 00000100:00100000:1.0:1788483137.470295:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788483137.470310:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072441472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788483137.470391:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875360072441472:12345-0@lo:400:kworker.0 Request processed in 85us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483137.470399:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788483137.471029:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483137.471296:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3279:1875360072441472:0@lo:400:kworker.0 00000100:00080000:0.0:1788483137.471346:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483137.471378:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072441600 00000100:00100000:0.0:1788483137.471383:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072441600 00000100:00080000:1.0:1788483137.471520:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483137.471662:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788483137.471673:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875360072441600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483137.473495:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875360072441600:12345-0@lo:400:kworker.0 Request processed in 1812us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483137.473514:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788483137.490519:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3277:1875360072441600:0@lo:400:kworker.0 00000001:00100000:1.0:1788483137.618216:0:7620:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49d72f1d-b874-4119-991a-de07c355679e 00010000:00010000:0.0:1788483138.100628:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483138.525732:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483138.525772:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483138.525792:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483138.525832:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483138.525852:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483138.525870:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483138.525893:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483138.525925:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064060032 00000100:00100000:3.0:1788483138.525937:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064060032 00000100:00100000:3.0:1788483138.526006:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064060416 00000100:00100000:3.0:1788483138.526009:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064060416 00000100:00100000:3.0:1788483138.526035:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788483138.526046:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2352:x1875360064060032:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483138.526140:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2352:x1875360064060032:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 95us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483138.526148:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788483138.526180:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1788483138.526187:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:2352:x1875360064060416:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483138.526212:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:2352:x1875360064060416:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483138.526218:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1788483138.526240:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064060288 00000100:00100000:3.0:1788483138.526243:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064060288 00000100:00100000:3.0:1788483138.526299:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064060544 00000100:00100000:3.0:1788483138.526302:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064060544 00000100:00100000:3.0:1788483138.526318:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064060160 00000100:00100000:3.0:1788483138.526321:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064060160 00000100:00100000:3.0:1788483138.526333:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064060672 00000100:00100000:3.0:1788483138.526336:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064060672 00000100:00100000:3.0:1788483138.526365:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:3.0:1788483138.526371:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2352:x1875360064060288:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483138.526406:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2352:x1875360064060288:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 35us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483138.526413:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:3.0:1788483138.526426:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1788483138.526432:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49d72f1d-b874-4119-991a-de07c355679e+5:2352:x1875360064060544:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483138.526454:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49d72f1d-b874-4119-991a-de07c355679e+5:2352:x1875360064060544:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483138.526461:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1788483138.526472:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788483138.526478:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2352:x1875360064060160:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483138.526500:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2352:x1875360064060160:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 23us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483138.526506:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788483138.526517:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788483138.526523:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49d72f1d-b874-4119-991a-de07c355679e+5:2352:x1875360064060672:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483138.526544:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49d72f1d-b874-4119-991a-de07c355679e+5:2352:x1875360064060672:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 22us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483138.526550:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788483138.526573:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064059904 00000100:00100000:3.0:1788483138.526577:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064059904 00000100:00100000:3.0:1788483138.526604:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00100000:3.0:1788483138.526611:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:2352:x1875360064059904:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483138.526636:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903855050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:2352:x1875360064059904:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483138.526649:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 103 00000100:00080000:3.0:1788483138.526695:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788483138.526700:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788483138.526703:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788483139.123423:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483140.018739:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788483140.018772:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072441728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483140.018871:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483140.019080:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072441728 00000100:00100000:2.0:1788483140.019091:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072441728 00000100:00100000:2.0:1788483140.019176:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788483140.019189:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072441728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483140.019236:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788483140.019323:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072441728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483140.019331:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788483140.019454:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483140.019546:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072441728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788483140.151443:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788483141.024088:0:16456:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd72b09350 20000000:00000080:1.0:1788483141.024125:0:16456:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9eb802cc1c00 uarg=0000000000000000 20000000:01000000:1.0:1788483141.024200:0:16456:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788483141.024211:0:16456:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788483141.024222:0:16456:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788483141.041840:0:16457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788483141.042895:0:16456:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788483141.059213:0:16456:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788483141.061578:0:16456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061604:0:16456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c4e expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061614:0:16456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79c9b expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061621:0:16456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79dcf expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061632:0:16456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061640:0:16456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061646:0:16456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061720:0:16456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061739:0:16456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 12 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483141.061758:0:16456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072441856:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483141.061917:0:16456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061927:0:16456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 12 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483141.061936:0:16456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072441984:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483141.061982:0:16456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad79dcf expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.061991:0:16456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad79dcf expref: 18 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483141.061999:0:16456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072442112:0@lo:104: 00000100:00100000:2.0:1788483141.062047:0:16456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788483141.062099:0:16456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad79c9b expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.062107:0:16456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad79c9b expref: 18 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483141.062128:0:16456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072442240:0@lo:104: 00000100:00100000:2.0:1788483141.062151:0:16456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788483141.062175:0:16456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x42820277aad79c4e expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.062184:0:16456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x42820277aad79c4e expref: 18 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483141.062192:0:16456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072442368:0@lo:104: 00000100:00100000:2.0:1788483141.062216:0:16456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483141.062227:0:16456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93a0676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788483141.066552:0:14329:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788483141.066589:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072442112 00000100:00100000:3.0:1788483141.066602:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072442112 00000100:00100000:3.0:1788483141.066660:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072442240 00000100:00100000:3.0:1788483141.066663:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072442240 00000100:00100000:3.0:1788483141.066675:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072442368 00000100:00100000:3.0:1788483141.066677:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072442368 00000100:00100000:3.0:1788483141.066696:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483141.066708:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+5:16456:x1875360072442112:12345-0@lo:104: 00010000:00010000:3.0:1788483141.066731:0:14329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.066842:0:14329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788483141.066849:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+5:16456:x1875360072442112:12345-0@lo:104: Request processed in 143us (4801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483141.066856:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483141.066876:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483141.066882:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+4:16456:x1875360072442240:12345-0@lo:104: 00010000:00010000:3.0:1788483141.066891:0:14329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.066934:0:14329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788483141.066956:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+4:16456:x1875360072442240:12345-0@lo:104: Request processed in 74us (4804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483141.066962:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788483141.066974:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788483141.066980:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb937b26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:16456:x1875360072442368:12345-0@lo:104: 00010000:00010000:3.0:1788483141.066988:0:14329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067022:0:14329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788483141.067027:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb937b26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+3:16456:x1875360072442368:12345-0@lo:104: Request processed in 48us (4810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483141.067033:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788483141.067095:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788483141.067102:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067110:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67200 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:3.0:1788483141.067116:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067125:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483141.067134:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483141.067140:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483141.067187:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067207:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483141.067230:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067238:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb910c67200/0x42820277aad79dcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79dd6 expref: -99 pid: 15745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067272:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788483141.067276:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067283:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f626600 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:3.0:1788483141.067286:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067294:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483141.067313:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483141.067319:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483141.067334:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067340:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483141.067346:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067352:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f626600/0x42820277aad79c9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79ca2 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067369:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788483141.067372:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067378:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f627e00 already unused, calling callback (ffffffffc1d2bc20) 10000000:00010000:3.0:1788483141.067382:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067388:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788483141.067395:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483141.067400:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788483141.067413:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067418:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788483141.067433:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067440:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9eb93f627e00/0x42820277aad79c4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x42820277aad79c55 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067455:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483141.067457:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483141.067459:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788483141.067466:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788483141.067482:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788483141.067499:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072442752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788483141.067537:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483141.067588:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072442752 00000100:00100000:3.0:1788483141.067592:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072442752 00010000:00010000:3.0:1788483141.067615:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79c4e expref: 19 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483141.067635:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483141.067642:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3278:x1875360072442752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788483141.067653:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483141.067659:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79c4e expref: 19 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067669:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad79c4e expref: 19 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.067690:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483141.067716:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3278:x1875360072442752:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483141.067723:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788483141.067756:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072442752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483141.068039:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3279:1875360072442496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483141.068070:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483141.068100:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483141.068106:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3279:1875360072442624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483141.068126:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483141.068153:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072442496 00000100:00100000:0.0:1788483141.068157:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072442496 00010000:00010000:0.0:1788483141.068175:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79dcf expref: 19 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483141.068188:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072442624 00000100:00100000:0.0:1788483141.068191:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072442624 00010000:00010000:0.0:1788483141.068203:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79c9b expref: 20 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483141.068215:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483141.068221:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+20:3279:x1875360072442496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483141.068229:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483141.068234:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79dcf expref: 20 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483141.068243:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad79dcf expref: 20 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483141.068311:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483141.068337:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+20:3279:x1875360072442496:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483141.068343:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788483141.068357:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483141.068363:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb939a31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3279:x1875360072442624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788483141.068379:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483141.068384:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x42820277aad79c9b expref: 19 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483141.068392:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x42820277aad79c9b expref: 19 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483141.068402:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483141.068420:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb939a31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3279:x1875360072442624:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483141.068426:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788483141.068472:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3279:1875360072442624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788483141.068479:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3279:1875360072442496:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788483141.068706:0:16456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d2a00/0x42820277aad79dd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad79dcf expref: 18 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483141.068721:0:16456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072442112:0@lo:104: 00010000:00010000:2.0:1788483141.068733:0:16456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb910c67c00/0x42820277aad79ca2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad79c9b expref: 17 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483141.068741:0:16456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072442240:0@lo:104: 00010000:00010000:2.0:1788483141.068750:0:16456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93fe14800/0x42820277aad79c55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x42820277aad79c4e expref: 16 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483141.068760:0:16456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072442368:0@lo:104: 00010000:00010000:1.0:1788483141.068898:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483141.073759:0:16456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb903110000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072441856:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483141.078502:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483141.078641:0:16456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16456:1875360072441984:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483141.078694:0:16456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483141.079304:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064060800 00000100:00100000:0.0:1788483141.079317:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064060800 00010000:00010000:0.0:1788483141.079385:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 13 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483141.079434:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1788483141.079447:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:2352:x1875360064060800:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483141.079467:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483141.079475:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 13 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483141.079489:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 13 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483141.079515:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d2e00/0x42820277aad79f34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e3d expref: 13 pid: 14340 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483141.079557:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483141.079640:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:2352:x1875360064060800:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 195us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483141.079649:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788483141.083216:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483141.083652:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064060928 00000100:00100000:1.0:1788483141.083670:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064060928 00010000:00010000:1.0:1788483141.083721:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 12 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483141.083793:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788483141.083804:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:2351:x1875360064060928:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483141.083826:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483141.083833:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 12 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083848:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 12 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083870:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb9421d2800/0x42820277aad79efc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ddb expref: 12 pid: 14338 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083893:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083903:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083926:0:14331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083933:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083940:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083948:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083975:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780c00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:1.0:1788483141.083981:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.083991:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.084014:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483141.084028:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483141.084101:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:2351:x1875360064060928:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 298us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483141.084111:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:2.0:1788483141.084651:0:16456:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.084664:0:16456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483141.084671:0:16456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9eb93f780c00/0x42820277aad79f5e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483141.170468:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788483142.197057:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483142.497938:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483142.498024:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064061056 00000100:00100000:1.0:1788483142.498039:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064061056 00000100:00100000:1.0:1788483142.498118:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:1.0:1788483142.498130:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+11:13761:x1875360064061056:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788483142.498153:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483142.498178:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb9421d2200/0x42820277aad79f65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e6e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483142.498224:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb9421d2200/0x42820277aad79f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e6e expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483142.498237:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb9421d2200/0x42820277aad79f65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e6e expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483142.498303:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb9421d2200, rc 0) 00000100:00100000:1.0:1788483142.498375:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903855850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13761:x1875360064061056:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 248us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483142.498383:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 104 00000100:00100000:1.0:1788483142.502811:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483142.503103:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064061184 00000100:00100000:0.0:1788483142.503117:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064061184 00000100:00100000:0.0:1788483142.503194:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:0.0:1788483142.503208:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13761:x1875360064061184:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.505077:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903855c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13761:x1875360064061184:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 1859us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483142.505092:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 105 00000100:00100000:0.0:1788483142.518245:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483142.518916:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064061312 00000100:00100000:0.0:1788483142.518930:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064061312 00000100:00100000:0.0:1788483142.519384:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:0.0:1788483142.519399:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13761:x1875360064061312:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.521586:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903856050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13761:x1875360064061312:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 1098us (7051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483142.521602:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 106 00000100:00100000:3.0:1788483142.526174:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483142.530731:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064061440 00000100:00100000:0.0:1788483142.530751:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064061440 00000100:00100000:0.0:1788483142.530842:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:0.0:1788483142.530857:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+12:13761:x1875360064061440:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483142.530881:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483142.530923:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907368a00/0x42820277aad79f6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e75 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.530963:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907368a00/0x42820277aad79f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e75 expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.530990:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907368a00/0x42820277aad79f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e75 expref: 13 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.531003:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368a00, rc 0) 00000100:00100000:0.0:1788483142.531085:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903856450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13761:x1875360064061440:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 232us (4926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483142.531093:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 107 00000100:00100000:3.0:1788483142.545637:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483142.545694:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064061568 00000100:00100000:0.0:1788483142.545710:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064061568 00000100:00100000:0.0:1788483142.545791:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:0.0:1788483142.545804:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13761:x1875360064061568:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.546186:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903857050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13761:x1875360064061568:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 384us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483142.546196:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 108 00000100:00100000:0.0:1788483142.550814:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483142.550889:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064061696 00000100:00100000:3.0:1788483142.550903:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064061696 00000100:00100000:3.0:1788483142.550979:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:3.0:1788483142.550992:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13761:x1875360064061696:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483142.551332:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903854450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:13761:x1875360064061696:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 342us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483142.551342:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 109 00000100:00100000:2.0:1788483142.578911:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788483142.578945:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072442880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483142.579049:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483142.579420:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072442880 00000100:00100000:3.0:1788483142.579492:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072442880 00000100:00100000:3.0:1788483142.579566:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788483142.579647:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072442880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788483142.579696:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788483142.579873:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072442880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 231us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483142.579882:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788483142.579909:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483142.579959:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072442880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788483142.580243:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072443136:0@lo:400:kworker.0 00000100:00100000:2.0:1788483142.580311:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483142.580345:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788483142.580351:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3280:1875360072443008:0@lo:400:kworker.0 00000100:00100000:2.0:1788483142.580385:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483142.580410:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072443520:0@lo:400:kworker.0 00000100:00100000:2.0:1788483142.580511:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483142.580542:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072443008 00000100:00100000:2.0:1788483142.580547:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072443008 00000100:00100000:2.0:1788483142.580651:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788483142.580661:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3280:x1875360072443008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483142.580702:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903857450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:3280:x1875360072443008:12345-0@lo:400:kworker.0 Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483142.580716:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788483142.580986:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3280:1875360072443008:0@lo:400:kworker.0 00000100:00100000:3.0:1788483142.581101:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072443136 00000100:00100000:3.0:1788483142.581106:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072443136 00000100:00100000:3.0:1788483142.581153:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483142.581162:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072443136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483142.581225:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072443136:12345-0@lo:400:kworker.0 Request processed in 64us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483142.581232:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788483142.581288:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072443520 00000100:00100000:3.0:1788483142.581291:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072443520 00000100:00100000:3.0:1788483142.581323:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788483142.581330:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072443520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483142.581378:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875360072443520:12345-0@lo:400:kworker.0 Request processed in 48us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483142.581386:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788483142.581396:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072443392:0@lo:400:kworker.0 00000100:00080000:3.0:1788483142.581415:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788483142.581421:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483142.581436:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483142.581478:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788483142.581485:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072443264:0@lo:400:kworker.0 00000100:00100000:0.0:1788483142.581520:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483142.581673:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3280:1875360072443520:0@lo:400:kworker.0 00000100:00100000:3.0:1788483142.581685:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072443136:0@lo:400:kworker.0 00000100:00100000:3.0:1788483142.581707:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072443392 00000100:00100000:3.0:1788483142.581710:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072443392 00000100:00100000:3.0:1788483142.581737:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072443264 00000100:00100000:3.0:1788483142.582718:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072443264 00000100:00100000:3.0:1788483142.582774:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788483142.582784:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072443392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483142.582852:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072443392:12345-0@lo:400:kworker.0 Request processed in 70us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483142.582860:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788483142.582874:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788483142.582881:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072443264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788483142.582910:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875360072443264:12345-0@lo:400:kworker.0 Request processed in 30us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483142.582917:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788483142.582952:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483142.583346:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875360072443264:0@lo:400:kworker.0 00000100:00100000:3.0:1788483142.583359:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072443392:0@lo:400:kworker.0 10000000:01000000:1.0:1788483142.770437:0:14342:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483142.770451:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb93a96c000 from 10 10000000:01000000:1.0:1788483142.770458:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483142.770524:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad79f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483142.770539:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad79f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483142.770554:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad79f73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483142.770689:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072443648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483142.770781:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483142.770857:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90d1d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483142.773389:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072443648 00000100:00100000:0.0:1788483142.773500:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072443648 00000100:00100000:0.0:1788483142.773658:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788483142.773672:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+16:14342:x1875360072443648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483142.773693:0:14339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483142.773721:0:14339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb907369200/0x42820277aad79f7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79f73 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.773760:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb907369200/0x42820277aad79f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79f73 expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.773773:0:14339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb907369200/0x42820277aad79f7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79f73 expref: 17 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.773784:0:14339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369200, rc 0) 00000100:00100000:0.0:1788483142.773892:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903856850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:14342:x1875360072443648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483142.773900:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788483142.773973:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072443648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483142.773997:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad79f73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f7a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.774007:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad79f73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79f7a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483142.774100:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072443776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.774136:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483142.774179:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483142.774194:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072443776 00000100:00100000:0.0:1788483142.774205:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072443776 00000100:00100000:0.0:1788483142.774228:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788483142.774234:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb903854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:14342:x1875360072443776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483142.781395:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb903854c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:14342:x1875360072443776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7145us (7243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483142.781417:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788483142.786355:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072443776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483142.786671:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072443904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788483142.786786:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483142.786854:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90d1d06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483142.787007:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072443904 00000100:00100000:0.0:1788483142.787016:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072443904 00000100:00100000:0.0:1788483142.787085:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788483142.787099:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb919cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:14342:x1875360072443904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.787385:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb919cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:14342:x1875360072443904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483142.787394:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788483142.787630:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072443904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788483142.790044:0:16507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788483142.791970:0:14342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788483142.792026:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788483142.792042:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad79f73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f7a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483142.792057:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb9421d3400/0x42820277aad79f73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f7a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788483142.792070:0:14342:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788483142.792073:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb910c1a000 from 10 10000000:01000000:3.0:1788483142.792076:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788483142.792128:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14a00/0x42820277aad79f81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483142.792137:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14a00/0x42820277aad79f81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483142.792152:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14a00/0x42820277aad79f81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483142.792186:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788483142.792387:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788483142.792768:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072444032 00000100:00100000:3.0:1788483142.792778:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072444032 00000100:00100000:3.0:1788483142.792849:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788483142.792862:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+17:14342:x1875360072444032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483142.792881:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483142.792899:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93fe14600/0x42820277aad79f88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79f81 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483142.792930:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93fe14600/0x42820277aad79f88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79f81 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483142.792953:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93fe14600/0x42820277aad79f88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79f81 expref: 18 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483142.792964:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14600, rc 0) 00000100:00100000:3.0:1788483142.793009:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:14342:x1875360072444032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483142.793017:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788483142.793079:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483142.793107:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788483142.793125:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14a00/0x42820277aad79f81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f88 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483142.793137:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14a00/0x42820277aad79f81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79f88 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483142.793209:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788483142.793239:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483142.802637:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483142.805727:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072444160 00000100:00100000:0.0:1788483142.805748:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072444160 00000100:00100000:0.0:1788483142.805904:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788483142.805919:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:14342:x1875360072444160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.806366:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:14342:x1875360072444160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 450us (13125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483142.806375:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788483142.807934:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788483142.808029:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788483142.808117:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483142.809306:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9066aad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788483142.814559:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072444288 00000100:00100000:3.0:1788483142.814597:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072444288 00000100:00100000:3.0:1788483142.814699:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788483142.814714:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:14342:x1875360072444288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788483142.815064:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:14342:x1875360072444288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 353us (6946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483142.815074:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788483142.819949:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788483142.824377:0:16508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788483142.825087:0:14342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788483142.825128:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788483142.825145:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14a00/0x42820277aad79f81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f88 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483142.825160:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb93fe14a00/0x42820277aad79f81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f88 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788483142.825173:0:14342:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788483142.825176:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9eb92163b000 from 10 10000000:01000000:1.0:1788483142.825179:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788483142.825280:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2800/0x42820277aad79f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483142.825290:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2800/0x42820277aad79f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483142.825304:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2800/0x42820277aad79f8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483142.825339:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788483142.825692:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788483142.825964:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb90d1d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483142.834596:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072444416 00000100:00100000:0.0:1788483142.834623:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072444416 00000100:00100000:2.0:1788483142.834851:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788483142.834867:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+18:14342:x1875360072444416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788483142.834892:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483142.834917:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9eb93f781400/0x42820277aad79f96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42820277aad79f8f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483142.834957:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9eb93f781400/0x42820277aad79f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x42820277aad79f8f expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483142.834971:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9eb93f781400/0x42820277aad79f96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x42820277aad79f8f expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483142.834983:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781400, rc 0) 00000100:00100000:2.0:1788483142.835100:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:14342:x1875360072444416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (9408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483142.835108:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788483142.835579:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788483142.835605:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2800/0x42820277aad79f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f96 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.835618:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2800/0x42820277aad79f8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x42820277aad79f96 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483142.835720:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.835778:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483142.835835:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034240 going to sleep for 11 seconds 00000100:00100000:1.0:1788483142.835915:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072444544 00000100:00100000:1.0:1788483142.835921:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072444544 00000100:00100000:1.0:1788483142.835961:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788483142.835970:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:14342:x1875360072444544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788483142.836318:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:14342:x1875360072444544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483142.836326:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788483142.840172:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.840299:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93ff52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.840412:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483142.840476:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034240 going to sleep for 11 seconds 00000100:00100000:0.0:1788483142.840499:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072444672 00000100:00100000:0.0:1788483142.840508:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072444672 00000100:00100000:0.0:1788483142.840564:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788483142.840575:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:14342:x1875360072444672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788483142.841623:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:14342:x1875360072444672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1046us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483142.841634:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788483142.841696:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93ff52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:34a2d1d6-061f-4613-bc6f-7f9dfae33666:14342:1875360072444672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788483142.851235:0:16510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788483142.851433:0:14342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788483142.851466:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788483142.851482:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2800/0x42820277aad79f8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f96 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483142.851497:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9eb9421d2800/0x42820277aad79f8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x42820277aad79f96 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483143.221128:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483143.658528:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483143.658929:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483143.658961:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483143.658993:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483143.659017:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483143.659039:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483143.659068:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483143.659113:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064062208 00000100:00100000:0.0:1788483143.659127:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064062208 00000100:00100000:0.0:1788483143.659203:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064062464 00000100:00100000:0.0:1788483143.659207:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064062464 00000100:00100000:0.0:1788483143.659223:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064062080 00000100:00100000:0.0:1788483143.659226:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064062080 00000100:00100000:0.0:1788483143.659238:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064062592 00000100:00100000:0.0:1788483143.659241:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064062592 00000100:00100000:1.0:1788483143.659375:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064061952 00000100:00100000:1.0:1788483143.659380:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064061952 00000100:00100000:1.0:1788483143.659420:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064062336 00000100:00100000:1.0:1788483143.659423:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064062336 00000100:00100000:1.0:1788483143.659451:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:1.0:1788483143.659465:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2353:x1875360064061952:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483143.661715:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788483143.661733:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2353:x1875360064062208:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483143.661819:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2353:x1875360064062208:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 91us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483143.661829:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788483143.661849:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788483143.661857:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49d72f1d-b874-4119-991a-de07c355679e+5:2353:x1875360064062464:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483143.661883:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49d72f1d-b874-4119-991a-de07c355679e+5:2353:x1875360064062464:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 28us (2922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483143.661890:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788483143.661915:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788483143.661923:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2353:x1875360064062080:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483143.661948:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2353:x1875360064062080:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483143.661961:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788483143.661974:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788483143.661981:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49d72f1d-b874-4119-991a-de07c355679e+5:2353:x1875360064062592:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483143.662006:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49d72f1d-b874-4119-991a-de07c355679e+5:2353:x1875360064062592:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (2937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483143.662013:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788483143.662045:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064061824 00000100:00100000:0.0:1788483143.662054:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064061824 00000100:00100000:0.0:1788483143.662088:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:0.0:1788483143.662096:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:2353:x1875360064061824:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483143.662121:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:2353:x1875360064061824:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483143.662128:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:0.0:1788483143.662170:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:0.0:1788483143.662179:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93ff50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+6:2353:x1875360064062336:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483143.662209:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+6:2353:x1875360064062336:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 32us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483143.662215:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00080000:0.0:1788483143.662243:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788483143.662275:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788483143.662278:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788483143.678400:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93ff52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2353:x1875360064061952:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 18917us (19866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483143.678421:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00010000:00010000:3.0:1788483144.242655:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483145.139708:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788483145.139743:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072444800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788483145.139864:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483145.140327:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072444800 00000100:00100000:2.0:1788483145.140340:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072444800 00000100:00100000:2.0:1788483145.140441:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788483145.140465:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072444800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788483145.140515:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788483145.140591:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072444800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483145.140599:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788483145.140889:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788483145.140981:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072444800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788483145.266701:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483145.336137:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483145.342098:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064062720 00000100:00100000:3.0:1788483145.342121:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064062720 00000100:00100000:3.0:1788483145.342351:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1788483145.342372:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:14414:x1875360064062720:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483145.342402:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483145.342431:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad79f9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e7c expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.342543:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.342565:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.342581:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.342600:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.342607:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.344385:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.346197:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad79fb2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.346362:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad79fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.346394:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad79fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483145.347793:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788483145.347804:0:16217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483145.347964:0:16217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad79fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.347985:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.347992:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348001:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348007:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483145.348013:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348023:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348041:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:3.0:1788483145.348045:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483145.348051:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348057:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad79fa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348085:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348092:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348099:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348105:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483145.348108:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348115:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348122:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483145.348125:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483145.348128:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348134:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad79fab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348184:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad79f9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e7c expref: 8 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348200:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15c00/0x42820277aad79fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e7c expref: 7 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.348218:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eb9231ebd00) 00010000:00010000:3.0:1788483145.348220:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483145.350969:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15c00, rc 0) 00000100:00100000:2.0:1788483145.351316:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:14414:x1875360064062720:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 8943us (15187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483145.351331:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00080000:0.0:1788483145.356927:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788483145.369600:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.369658:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064062976 00000100:00100000:1.0:1788483145.369671:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064062976 00000100:00100000:1.0:1788483145.369740:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788483145.369752:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:14414:x1875360064062976:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788483145.369780:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483145.369807:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2a00/0x42820277aad79fb9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e83 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.369909:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.369927:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.369941:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.370176:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.370203:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.370215:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.373137:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2200/0x42820277aad79fce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.373161:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2200/0x42820277aad79fce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.373176:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2200/0x42820277aad79fce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483145.373192:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788483145.374779:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374795:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374803:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374810:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb9421d2e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.374815:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374837:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374854:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9eb9231ebd00) 00010000:00010000:1.0:1788483145.374857:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.374862:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374868:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2e00/0x42820277aad79fc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374884:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374890:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374896:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374901:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93ebd2a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.374903:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374909:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374916:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9eb923cf3000) 00010000:00010000:1.0:1788483145.374918:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.374921:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.374937:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fc7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.382628:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d2a00/0x42820277aad79fb9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e83 expref: 10 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.382658:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2200/0x42820277aad79fce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e83 expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.382669:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb923cf3600) 00010000:00010000:1.0:1788483145.382672:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.382687:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93ebd2200, rc 0) 00000100:00100000:1.0:1788483145.382765:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14414:x1875360064062976:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 13014us (13181us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788483145.382774:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788483145.390653:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483145.391180:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064063104 00000100:00100000:3.0:1788483145.391191:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064063104 00000100:00100000:3.0:1788483145.391320:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788483145.391334:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14414:x1875360064063104:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788483145.392133:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14414:x1875360064063104:12345-192.168.201.6@tcp:59:lhsmtool_posix.0 Request processed in 800us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483145.392145:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1788483145.442998:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.443111:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064063232 00000100:00100000:1.0:1788483145.443121:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064063232 00000100:00100000:1.0:1788483145.443192:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788483145.443203:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14420:x1875360064063232:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788483145.443234:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483145.443296:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e8a expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443361:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443393:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443406:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443420:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443428:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443435:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443901:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443910:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443916:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443922:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93ebd2400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.443926:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443935:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443947:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:1.0:1788483145.443957:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.443962:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443969:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad79fe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443983:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443989:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.443995:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.444000:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93ebd3000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.444003:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.444009:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.444016:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eb923cf3000) 00010000:00010000:1.0:1788483145.444019:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.444022:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.444027:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad79fea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.444061:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fdc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e8a expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.444079:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:1.0:1788483145.444082:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.444086:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e8a expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.444097:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93ebd2a00, rc 0) 00000100:00100000:1.0:1788483145.444181:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14420:x1875360064063232:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 979us (1193us total) trans 0 rc 301/301 00000100:00100000:1.0:1788483145.444190:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:2.0:1788483145.451864:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.451980:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064063360 00000100:00100000:1.0:1788483145.451991:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064063360 00000100:00100000:1.0:1788483145.452046:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1788483145.452058:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14420:x1875360064063360:12345-192.168.201.6@tcp:700:lfs.0 00000100:00100000:1.0:1788483145.456850:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14420:x1875360064063360:12345-192.168.201.6@tcp:700:lfs.0 Request processed in 4782us (4985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483145.456866:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1788483145.487588:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483145.487783:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064063616 00000100:00100000:2.0:1788483145.487796:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064063616 00000100:00100000:2.0:1788483145.487858:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:2.0:1788483145.487870:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14420:x1875360064063616:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:2.0:1788483145.487926:0:16217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483145.487954:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad79f1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e05 expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.487975:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:2.0:1788483145.487979:0:16217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483145.488797:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.488816:0:16217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 5 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.488839:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.488884:0:16217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 5 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.488901:0:16217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 5 pid: 16217 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483145.488919:0:16217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16217:1875360072444928:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483145.491443:0:16217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9030693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483145.497649:0:16217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e12680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16217:1875360072444928:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483145.497680:0:16217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483145.498126:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483145.498190:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064063744 00000100:00100000:3.0:1788483145.498198:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064063744 00010000:00010000:3.0:1788483145.498322:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 6 pid: 16217 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788483145.498358:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788483145.498361:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788483145.498371:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49d72f1d-b874-4119-991a-de07c355679e+6:2351:x1875360064063744:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483145.498387:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483145.498394:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 6 pid: 16217 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.498408:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 6 pid: 16217 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.498431:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb9421d3600/0x42820277aad79f57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e67 expref: 6 pid: 16217 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.498463:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:3.0:1788483145.498468:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.498477:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.498484:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.498509:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483145.498563:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49d72f1d-b874-4119-991a-de07c355679e+5:2351:x1875360064063744:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 193us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483145.498570:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00010000:00010000:2.0:1788483145.498626:0:16217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.498634:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.498656:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.498665:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.498673:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483145.500038:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788483145.500054:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.500065:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.500073:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.500080:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483145.500085:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.500094:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.500108:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:2.0:1788483145.500112:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483145.500117:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.500124:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad79ff1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483145.500143:0:16217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b1de2c4 reply state 00000000d60a0c74 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483145.500155:0:16217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483145.500295:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+10:14420:x1875360064063616:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 12425us (12715us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788483145.500314:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00010000:00010000:1.0:1788483145.509289:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.509309:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.509317:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.509323:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.509344:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.509353:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.509373:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eb902ab1300) 00010000:00010000:1.0:1788483145.509376:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.509382:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.509388:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad79ff8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483145.619807:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.619980:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064063872 00000100:00100000:1.0:1788483145.619992:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064063872 00000100:00100000:1.0:1788483145.620100:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788483145.620112:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:14428:x1875360064063872:12345-192.168.201.6@tcp:101:lctl.0 00010000:00010000:1.0:1788483145.620137:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483145.620160:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e91 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.620238:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad7a006 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.620288:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad7a006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.620301:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad7a006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483145.620380:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788483145.620384:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788483145.620425:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad7a006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.620450:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad79fff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e91 expref: 11 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.620467:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3000/0x42820277aad7a006 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e91 expref: 10 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.620476:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:1.0:1788483145.620479:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483145.620482:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93ebd3000, rc 0) 00000100:00100000:1.0:1788483145.620531:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+10:14428:x1875360064063872:12345-192.168.201.6@tcp:101:lctl.0 Request processed in 421us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483145.620537:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:0.0:1788483145.665083:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483145.670862:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064064000 00000100:00100000:3.0:1788483145.670877:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064064000 00000100:00100000:3.0:1788483145.671038:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:3.0:1788483145.671050:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb801ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49d72f1d-b874-4119-991a-de07c355679e+5:14429:x1875360064064000:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483145.671069:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483145.671090:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a00d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e98 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.671169:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7a014 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.671183:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7a014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.671196:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7a014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483145.671301:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788483145.671305:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483145.671334:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7a014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.671357:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a00d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e98 expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.671375:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14000/0x42820277aad7a014 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e98 expref: 6 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.671384:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:3.0:1788483145.671387:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483145.671391:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14000, rc 0) 00000100:00100000:3.0:1788483145.671472:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb801ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49d72f1d-b874-4119-991a-de07c355679e+6:14429:x1875360064064000:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 424us (6401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483145.671479:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 21 00000100:00100000:2.0:1788483145.680050:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.680298:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064064128 00000100:00100000:1.0:1788483145.680309:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064064128 00000100:00100000:1.0:1788483145.680364:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1788483145.680375:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:14429:x1875360064064128:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788483145.680399:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483145.680419:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad7a01b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077e9f expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680491:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680524:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680535:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680550:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680557:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680564:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680896:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2600/0x42820277aad7a030 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680906:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2600/0x42820277aad7a030 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680913:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2600/0x42820277aad7a030 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483145.680955:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788483145.680959:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788483145.680987:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2600/0x42820277aad7a030 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.680999:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681016:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681024:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681030:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93ebd2400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.681034:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681042:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681054:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:1.0:1788483145.681057:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.681061:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681067:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a022 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681081:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681088:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681094:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681099:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93ebd3a00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.681107:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681114:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681122:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eb923cf3c00) 00010000:00010000:1.0:1788483145.681125:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.681128:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.681135:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a029 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.682312:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2a00/0x42820277aad7a01b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e9f expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.682337:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2600/0x42820277aad7a030 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e9f expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.682347:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3900) 00010000:00010000:1.0:1788483145.682349:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483145.682352:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93ebd2600, rc 0) 00000100:00100000:1.0:1788483145.682433:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+7:14429:x1875360064064128:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 2058us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483145.682442:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:0.0:1788483145.692431:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483145.692539:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064064384 00000100:00100000:2.0:1788483145.692551:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064064384 00000100:00100000:2.0:1788483145.692615:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:2.0:1788483145.692628:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+7:14429:x1875360064064384:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483145.692651:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483145.692673:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ea6 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483145.692786:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788483145.692911:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a037 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ea6 expref: 9 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.692925:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:2.0:1788483145.692929:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483145.692934:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ea6 expref: 9 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.693074:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780400, rc 0) 00000100:00100000:2.0:1788483145.693139:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49d72f1d-b874-4119-991a-de07c355679e+8:14429:x1875360064064384:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 514us (718us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788483145.693147:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 23 00000100:00100000:3.0:1788483145.697497:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483145.697542:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064064640 00000100:00100000:2.0:1788483145.697557:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064064640 00000100:00100000:2.0:1788483145.697625:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:2.0:1788483145.697635:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49d72f1d-b874-4119-991a-de07c355679e+8:14429:x1875360064064640:12345-192.168.201.6@tcp:36:lfs.0 00010000:00010000:2.0:1788483145.697706:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483145.697731:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2600/0x42820277aad7a030 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077e9f expref: 8 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.697751:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3900) 00010000:00010000:2.0:1788483145.697762:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483145.697784:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.697796:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.697805:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483145.699775:0:14347:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c53763cc reply state 00000000fdb87598 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483145.699796:0:14347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788483145.699840:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788483145.704467:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49d72f1d-b874-4119-991a-de07c355679e+9:14429:x1875360064064640:12345-192.168.201.6@tcp:36:lfs.0 Request processed in 6818us (6965us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788483145.704481:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00010000:00010000:1.0:1788483145.707323:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.707341:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.707363:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.707370:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.707375:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.707383:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.707400:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb902ab1b00) 00010000:00010000:1.0:1788483145.707403:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788483145.707408:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.707415:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a045 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483145.707779:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.708053:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064064896 00000100:00100000:1.0:1788483145.708062:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064064896 00000100:00100000:1.0:1788483145.708115:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:1.0:1788483145.708125:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49d72f1d-b874-4119-991a-de07c355679e+8:14429:x1875360064064896:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788483145.709156:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49d72f1d-b874-4119-991a-de07c355679e+9:14429:x1875360064064896:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 1028us (1376us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788483145.709168:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:2.0:1788483145.734684:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483145.735285:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064065152 00000100:00100000:3.0:1788483145.735296:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064065152 00000100:00100000:3.0:1788483145.735363:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:3.0:1788483145.735374:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49d72f1d-b874-4119-991a-de07c355679e+9:14429:x1875360064065152:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:3.0:1788483145.735401:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483145.735422:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a04c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ead expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.735525:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.735539:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.735550:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.735564:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.735571:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.735578:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483145.735725:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788483145.735823:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736184:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736192:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736198:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483145.736203:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736234:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736702:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:3.0:1788483145.736707:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483145.736714:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736720:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a053 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736736:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736742:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736749:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736754:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483145.736757:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736763:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736772:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eb9231ebe00) 00010000:00010000:3.0:1788483145.736774:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483145.736776:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.736794:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a05a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.737074:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a04c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ead expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.737085:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:3.0:1788483145.737087:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483145.737090:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a04c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ead expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483145.737101:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15000, rc 0) 00000100:00100000:3.0:1788483145.738133:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49d72f1d-b874-4119-991a-de07c355679e+10:14429:x1875360064065152:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 2754us (3453us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788483145.738144:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 25 00000100:00100000:0.0:1788483145.741894:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.741968:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064065280 00000100:00100000:1.0:1788483145.741985:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064065280 00000100:00100000:1.0:1788483145.742056:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1788483145.742068:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+10:14429:x1875360064065280:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:1.0:1788483145.742105:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483145.742126:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a068 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077eb4 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.742236:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.742295:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.742307:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483145.742601:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788483145.742606:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788483145.743081:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.743445:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3a00/0x42820277aad7a068 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 12 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.743467:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.743476:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3c00) 00010000:00010000:1.0:1788483145.743479:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788483145.743483:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93ebd2400, rc 0) 00000100:00100000:1.0:1788483145.743556:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+11:14429:x1875360064065280:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1489us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483145.743565:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:0.0:1788483145.749011:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483145.749175:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064065408 00000100:00100000:3.0:1788483145.749193:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064065408 00000100:00100000:3.0:1788483145.749325:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:3.0:1788483145.749342:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49d72f1d-b874-4119-991a-de07c355679e+11:14429:x1875360064065408:12345-192.168.201.6@tcp:37:lfs.0 00000100:00100000:0.0:1788483145.755114:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49d72f1d-b874-4119-991a-de07c355679e+11:14429:x1875360064065408:12345-192.168.201.6@tcp:37:lfs.0 Request processed in 5761us (6106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483145.755136:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 3 00000100:00100000:0.0:1788483145.760900:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.761355:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064065664 00000100:00100000:1.0:1788483145.761371:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064065664 00000100:00100000:1.0:1788483145.761448:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:1.0:1788483145.761459:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb929de0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49d72f1d-b874-4119-991a-de07c355679e+11:14429:x1875360064065664:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788483145.761908:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb929de0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49d72f1d-b874-4119-991a-de07c355679e+12:14429:x1875360064065664:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 450us (1024us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788483145.761917:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00000040:00080000:0.0:1788483145.779243:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788483145.835881:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483145.835969:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064065792 00000100:00100000:0.0:1788483145.835979:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064065792 00000100:00100000:0.0:1788483145.836041:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:0.0:1788483145.836052:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+10:14435:x1875360064065792:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:0.0:1788483145.836071:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483145.836093:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad7a076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ebb expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836168:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836184:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836223:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836244:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836283:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836291:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836408:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7a08b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836417:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7a08b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836425:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7a08b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483145.836454:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788483145.836457:0:16217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788483145.836497:0:16217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7a08b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836509:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836516:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836533:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836539:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907369c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483145.836556:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836565:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836577:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:0.0:1788483145.836581:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483145.836585:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836592:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a07d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836606:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836621:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836628:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836634:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb907368000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483145.836637:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836662:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836672:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9eb907174700) 00010000:00010000:0.0:1788483145.836674:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483145.836677:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836683:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a084 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836714:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369800/0x42820277aad7a076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ebb expref: 12 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836730:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368200/0x42820277aad7a08b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ebb expref: 11 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.836737:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3c00) 00010000:00010000:0.0:1788483145.836740:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788483145.836742:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368200, rc 0) 00000100:00100000:0.0:1788483145.836797:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+11:14435:x1875360064065792:12345-192.168.201.6@tcp:101:bash.0 Request processed in 747us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483145.836805:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 27 00000100:00100000:2.0:1788483145.842727:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483145.842933:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064066048 00000100:00100000:1.0:1788483145.842948:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064066048 00000100:00100000:1.0:1788483145.843056:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 28 00000100:00100000:1.0:1788483145.843070:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+11:14435:x1875360064066048:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:1.0:1788483145.843099:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483145.843126:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3c00/0x42820277aad7a092 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ec2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.843717:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.843736:0:14347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.843747:0:14347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.843846:0:14347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 11 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.843880:0:14347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 11 pid: 14346 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483145.843897:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb9217e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14347:1875360072445056:192.168.201.6@tcp:104: 00000100:00100000:1.0:1788483145.844067:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93a0676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788483145.848783:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483145.848991:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb9217e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14347:1875360072445056:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483145.849025:0:14347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483145.849132:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064066176 00000100:00100000:0.0:1788483145.849142:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064066176 00010000:00010000:0.0:1788483145.849199:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 12 pid: 14346 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483145.849286:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788483145.849300:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49d72f1d-b874-4119-991a-de07c355679e+12:2352:x1875360064066176:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483145.849318:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483145.849327:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 12 pid: 14346 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.849340:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 12 pid: 14346 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.849365:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2400/0x42820277aad7a06f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eb4 expref: 12 pid: 14346 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.849392:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3c00) 00010000:00010000:0.0:1788483145.849398:0:14332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.849410:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.849418:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483145.849455:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483145.849529:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49d72f1d-b874-4119-991a-de07c355679e+11:2352:x1875360064066176:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 232us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483145.849537:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00010000:00010000:2.0:1788483145.849729:0:14347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.849738:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.849777:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.849788:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.849797:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850835:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850847:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850857:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483145.850870:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788483145.850906:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850914:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850922:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850936:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93ebd3200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483145.850941:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850949:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850960:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3c00) 00010000:00010000:2.0:1788483145.850963:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483145.850967:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.850973:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3200/0x42820277aad7a099 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483145.850986:0:14347:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001feda9e4 reply state 00000000add61e7d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483145.850997:0:14347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788483145.851036:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3c00/0x42820277aad7a092 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 14 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.851050:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.851059:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:2.0:1788483145.851061:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788483145.851064:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780400, rc 0) 00000100:00100000:2.0:1788483145.851119:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+14:14435:x1875360064066048:12345-192.168.201.6@tcp:101:bash.0 Request processed in 8052us (8411us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788483145.851135:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 28 00010000:00010000:1.0:1788483145.860162:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.860185:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.860195:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.860201:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483145.860208:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.860228:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.860284:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9eb902ab1600) 00010000:00010000:1.0:1788483145.860288:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483145.860294:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483145.860301:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781600/0x42820277aad7a0a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483145.869890:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483145.870230:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064066304 00000100:00100000:2.0:1788483145.870244:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064066304 00000100:00100000:2.0:1788483145.870355:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1788483145.870368:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+13:14435:x1875360064066304:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788483145.870683:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483145.870712:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a0b5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ec9 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.870801:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a0bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.870816:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a0bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.870828:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a0bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483145.870877:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788483145.870882:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483145.870904:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a0bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.870916:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a0bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.870946:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a0b5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec9 expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.870965:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a0bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec9 expref: 14 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.870992:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:2.0:1788483145.870996:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483145.871000:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780a00, rc 0) 00000100:00100000:2.0:1788483145.871082:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+14:14435:x1875360064066304:12345-192.168.201.6@tcp:101:bash.0 Request processed in 716us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483145.871091:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1788483145.876143:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483145.876288:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064066560 00000100:00100000:0.0:1788483145.876321:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064066560 00000100:00100000:0.0:1788483145.876405:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:0.0:1788483145.876418:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+14:14435:x1875360064066560:12345-192.168.201.6@tcp:35:bash.0 00000100:00100000:0.0:1788483145.877337:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+15:14435:x1875360064066560:12345-192.168.201.6@tcp:35:bash.0 Request processed in 918us (1206us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788483145.877349:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788483145.961552:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483145.961680:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064066816 00000100:00100000:2.0:1788483145.961695:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064066816 00000100:00100000:2.0:1788483145.961875:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:2.0:1788483145.961889:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+15:14445:x1875360064066816:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483145.961925:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483145.961952:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a0c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ed0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483145.962109:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788483145.962923:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a0c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ed0 expref: 17 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.962943:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:2.0:1788483145.962946:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483145.962953:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a0c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ed0 expref: 17 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483145.962971:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780800, rc 0) 00000100:00100000:2.0:1788483145.963052:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+16:14445:x1875360064066816:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1166us (1516us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788483145.963078:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788483145.967364:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483145.967560:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064067072 00000100:00100000:2.0:1788483145.967574:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064067072 00000100:00100000:2.0:1788483145.967695:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:2.0:1788483145.967708:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+16:14445:x1875360064067072:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788483145.968035:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14445:x1875360064067072:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 329us (684us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788483145.968044:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:3.0:1788483146.000656:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483146.000724:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064067328 00000100:00100000:2.0:1788483146.000738:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064067328 00000100:00100000:2.0:1788483146.000856:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:2.0:1788483146.000881:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14448:x1875360064067328:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483146.000915:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483146.000942:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a0d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ed7 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.001067:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad7a0d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.001085:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad7a0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.001098:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad7a0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483146.001112:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788483146.001326:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780800/0x42820277aad7a0d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ed7 expref: 20 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.001369:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad7a0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ed7 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.001437:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:2.0:1788483146.001442:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483146.001447:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781200, rc 0) 00000100:00100000:2.0:1788483146.001516:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+19:14448:x1875360064067328:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 648us (874us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788483146.001524:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 31 00000100:00100000:1.0:1788483146.008541:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483146.012859:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483146.013002:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064067584 00000100:00100000:0.0:1788483146.013024:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064067584 00000100:00100000:0.0:1788483146.013139:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:0.0:1788483146.013152:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+19:2352:x1875360064067584:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483146.013172:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483146.013207:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781200/0x42820277aad7a0d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ed7 expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483146.013304:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:0.0:1788483146.013310:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483146.013595:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+18:2352:x1875360064067584:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 445us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483146.013604:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788483146.014492:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064067456 00000100:00100000:2.0:1788483146.014510:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064067456 00000100:00100000:3.0:1788483146.016820:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1788483146.016837:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb9217e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+18:14448:x1875360064067456:12345-192.168.201.6@tcp:54:lfs.0 00010000:00010000:3.0:1788483146.016945:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.016987:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.017001:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.017036:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.017043:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.017050:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.017057:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483146.017062:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.017070:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.017083:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:3.0:1788483146.017087:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483146.017092:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.017099:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a0e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483146.017335:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb9217e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+18:14448:x1875360064067456:12345-192.168.201.6@tcp:54:lfs.0 Request processed in 501us (8808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483146.017349:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 32 00000100:00100000:3.0:1788483146.026854:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483146.027598:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064067840 00000100:00100000:0.0:1788483146.027614:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064067840 00000100:00100000:0.0:1788483146.027691:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1788483146.027705:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+18:14448:x1875360064067840:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:0.0:1788483146.027981:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+19:14448:x1875360064067840:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 278us (1142us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788483146.027989:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000001:00080000:2.0:1788483146.226962:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:2.0:1788483146.226989:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1788483146.290752:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483146.432537:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483146.432671:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064068096 00000100:00100000:0.0:1788483146.432688:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064068096 00000100:00100000:0.0:1788483146.432777:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:0.0:1788483146.432791:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+11:14479:x1875360064068096:12345-192.168.201.6@tcp:101:cat.0 00010000:00010000:0.0:1788483146.432829:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483146.432858:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a0ed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ede expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483146.433008:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a0f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483146.433025:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483146.433039:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483146.433054:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788483146.433335:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a0ed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ede expref: 14 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483146.433369:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ede expref: 13 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483146.433379:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:0.0:1788483146.433382:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788483146.433386:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907369c00, rc 0) 00000100:00100000:0.0:1788483146.435589:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+13:14479:x1875360064068096:12345-192.168.201.6@tcp:101:cat.0 Request processed in 2791us (3349us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788483146.435623:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 33 00000100:00100000:1.0:1788483146.450991:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483146.453759:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064068224 00000100:00100000:3.0:1788483146.453776:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064068224 00000100:00100000:3.0:1788483146.453862:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:3.0:1788483146.453876:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+13:2351:x1875360064068224:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483146.453896:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483146.453928:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907369c00/0x42820277aad7a0f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ede expref: 13 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483146.453949:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:3.0:1788483146.453955:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483146.456101:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+12:2351:x1875360064068224:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 2216us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483146.456115:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 1 00000100:00100000:0.0:1788483146.456445:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483146.456524:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064068480 00000100:00100000:2.0:1788483146.456534:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064068480 00000100:00100000:2.0:1788483146.456582:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:2.0:1788483146.456593:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+12:14479:x1875360064068480:12345-192.168.201.6@tcp:35:cat.0 00000001:00080000:2.0:1788483146.456939:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934607 00000100:00100000:2.0:1788483146.457049:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+14:14479:x1875360064068480:12345-192.168.201.6@tcp:35:cat.0 Request processed in 458us (605us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788483146.457058:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000020:00080000:2.0:1788483146.457062:0:14349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788483146.586173:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483146.586305:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064068736 00000100:00100000:1.0:1788483146.586319:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064068736 00000100:00100000:1.0:1788483146.586401:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:1.0:1788483146.586415:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+14:14485:x1875360064068736:12345-192.168.201.6@tcp:101:dd.0 00010000:00010000:1.0:1788483146.586447:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483146.586474:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3400/0x42820277aad7a102 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ee5 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.586667:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3e00/0x42820277aad7a109 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.586684:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3e00/0x42820277aad7a109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.586698:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3e00/0x42820277aad7a109 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483146.586713:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788483146.587195:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3400/0x42820277aad7a102 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ee5 expref: 17 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.587244:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3e00/0x42820277aad7a109 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ee5 expref: 16 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.587325:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:1.0:1788483146.587329:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483146.587333:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93ebd3e00, rc 0) 00000100:00100000:1.0:1788483146.587467:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+16:14485:x1875360064068736:12345-192.168.201.6@tcp:101:dd.0 Request processed in 1054us (1308us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1788483146.587475:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:0.0:1788483146.599613:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483146.599711:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064068992 00000100:00100000:2.0:1788483146.599726:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064068992 00000100:00100000:2.0:1788483146.599807:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 35 00000100:00100000:2.0:1788483146.599841:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+16:14485:x1875360064068992:12345-192.168.201.6@tcp:36:dd.0 00010000:00010000:2.0:1788483146.599930:0:16217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788483146.599972:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3e00/0x42820277aad7a109 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ee5 expref: 16 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.600001:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a0bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec9 expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.600014:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:2.0:1788483146.600019:0:16217:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483146.600339:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.600357:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483146.600370:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483146.600427:0:16217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:2.0:1788483146.600454:0:16217:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea9934d5 reply state 00000000aa078a2d transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483146.600466:0:16217:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483146.600589:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14485:x1875360064068992:12345-192.168.201.6@tcp:36:dd.0 Request processed in 751us (990us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788483146.600597:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 35 00000020:00080000:2.0:1788483146.600604:0:16217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788483146.607547:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.607577:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.607588:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.607596:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780e00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483146.607602:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.607612:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.607642:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:1.0:1788483146.607656:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483146.607664:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483146.607694:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780e00/0x42820277aad7a117 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483146.746535:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483146.746706:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064069248 00000100:00100000:2.0:1788483146.746719:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064069248 00000100:00100000:2.0:1788483146.746816:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788483146.746831:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+16:14485:x1875360064069248:12345-192.168.201.6@tcp:35:dd.0 00000100:00100000:2.0:1788483146.747744:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14485:x1875360064069248:12345-192.168.201.6@tcp:35:dd.0 Request processed in 912us (1235us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788483146.747755:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000040:00080000:0.0:1788483146.803313:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788483147.010755:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483147.010917:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064069376 00000100:00100000:1.0:1788483147.010932:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064069376 00000100:00100000:1.0:1788483147.011037:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00100000:1.0:1788483147.011054:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14499:x1875360064069376:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:1.0:1788483147.011100:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788483147.011130:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3400/0x42820277aad7a11e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077eec expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011287:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011305:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011323:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011343:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011351:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011357:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011795:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3600/0x42820277aad7a133 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011828:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3600/0x42820277aad7a133 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011836:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3600/0x42820277aad7a133 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788483147.011884:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788483147.011889:0:14347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788483147.011938:0:14347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3600/0x42820277aad7a133 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011953:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3600/0x42820277aad7a133 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011962:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011969:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011977:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011984:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93ebd3800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483147.011989:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.011997:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012012:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3c00) 00010000:00010000:1.0:1788483147.012023:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483147.012030:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012037:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3800/0x42820277aad7a125 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012055:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012061:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012067:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012072:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93ebd2800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483147.012076:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012082:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012090:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9eb923cf3800) 00010000:00010000:1.0:1788483147.012093:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483147.012096:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012102:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd2800/0x42820277aad7a12c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012144:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3400/0x42820277aad7a11e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eec expref: 19 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012174:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3600/0x42820277aad7a133 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eec expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.012181:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:1.0:1788483147.012184:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788483147.012186:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93ebd3600, rc 0) 00000100:00100000:1.0:1788483147.012331:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+18:14499:x1875360064069376:12345-192.168.201.6@tcp:101:stat.0 Request processed in 1281us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483147.012340:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 36 00000100:00080000:0.0:1788483147.013709:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483147.112493:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483147.112605:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064069632 00000100:00100000:3.0:1788483147.112620:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064069632 00000100:00100000:3.0:1788483147.112700:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 37 00000100:00100000:3.0:1788483147.112712:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+18:14505:x1875360064069632:12345-192.168.201.6@tcp:36:truncate.0 00010000:00010000:3.0:1788483147.112800:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483147.112961:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93ebd3600/0x42820277aad7a133 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077eec expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.112987:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:3.0:1788483147.112994:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788483147.113571:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.113589:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.113600:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483147.113661:0:14345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934613 00000004:00010000:3.0:1788483147.113692:0:14345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e244995 reply state 00000000885dbd77 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483147.113703:0:14345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483147.113872:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+20:14505:x1875360064069632:12345-192.168.201.6@tcp:36:truncate.0 Request processed in 1157us (1393us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788483147.113881:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 37 00000020:00080000:3.0:1788483147.113888:0:14345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788483147.126245:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.126306:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.126316:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.126322:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483147.126328:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.126336:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.126358:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:1.0:1788483147.126361:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483147.126366:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.126389:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a13a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.315995:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788483147.375971:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.376291:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064069760 00000100:00100000:2.0:1788483147.376307:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064069760 00000100:00100000:2.0:1788483147.376404:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:2.0:1788483147.376425:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+19:14519:x1875360064069760:12345-192.168.201.6@tcp:101:stat.0 00010000:00010000:2.0:1788483147.376461:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483147.376491:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a141 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077ef3 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.376586:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.376602:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.376613:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.376629:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.376635:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.376642:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377077:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377088:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377096:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483147.377154:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788483147.377160:0:14346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483147.377205:0:14346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377221:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377230:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377238:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377245:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377293:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483147.377299:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377307:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377328:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3c00) 00010000:00010000:2.0:1788483147.377331:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483147.377336:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377342:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a148 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377355:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377361:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377367:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377372:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483147.377375:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377381:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377387:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9eb902ab1400) 00010000:00010000:2.0:1788483147.377389:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483147.377391:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377396:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a14f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377444:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a141 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 21 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377456:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 20 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.377465:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:2.0:1788483147.377467:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483147.377469:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780000, rc 0) 00000100:00100000:2.0:1788483147.377553:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+20:14519:x1875360064069760:12345-192.168.201.6@tcp:101:stat.0 Request processed in 1131us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.377561:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:0.0:1788483147.556465:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.556532:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064070016 00000100:00100000:2.0:1788483147.556547:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064070016 00000100:00100000:2.0:1788483147.556675:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:2.0:1788483147.556689:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+20:14529:x1875360064070016:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:2.0:1788483147.556717:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483147.556743:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a15d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077efa expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483147.557094:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788483147.557352:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a15d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077efa expref: 22 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.557370:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:2.0:1788483147.557373:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788483147.557455:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a15d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077efa expref: 22 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.557471:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780a00, rc 0) 00000100:00100000:2.0:1788483147.557553:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+21:14529:x1875360064070016:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 866us (1106us total) trans 8589934615 rc 301/301 00000100:00100000:2.0:1788483147.557560:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 39 00000100:00100000:0.0:1788483147.561150:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483147.561359:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064070272 00000100:00100000:1.0:1788483147.561372:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064070272 00000100:00100000:1.0:1788483147.561455:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:1.0:1788483147.561468:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb94207e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+21:14529:x1875360064070272:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:1.0:1788483147.562695:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb94207e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+22:14529:x1875360064070272:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 1226us (1550us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788483147.562705:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:0.0:1788483147.619230:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.619465:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064070528 00000100:00100000:2.0:1788483147.619478:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064070528 00000100:00100000:2.0:1788483147.619541:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:2.0:1788483147.619551:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+22:14535:x1875360064070528:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788483147.619577:0:14346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483147.619599:0:14346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a16b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f01 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.619706:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.619718:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 23 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.619725:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 23 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.619737:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.619770:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 23 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.619805:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 23 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483147.619818:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14346:1875360072445184:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483147.619938:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 23 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.619949:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 23 pid: 14347 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483147.619955:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14346:1875360072445312:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483147.619973:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788483147.623537:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483147.623562:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483147.623632:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064070784 00000100:00100000:1.0:1788483147.623643:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064070784 00010000:00010000:1.0:1788483147.623684:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 24 pid: 14347 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483147.623719:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064070656 00000100:00100000:1.0:1788483147.623721:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064070656 00010000:00010000:1.0:1788483147.623730:0:14332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 25 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788483147.623748:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788483147.623756:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb939a33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:2351:x1875360064070784:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483147.623769:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483147.623775:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 25 pid: 14347 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.623785:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 25 pid: 14347 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.623832:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:1.0:1788483147.623836:0:14332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.623845:0:14332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.623849:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483147.623912:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb939a33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:2351:x1875360064070784:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 157us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483147.623917:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788483147.624166:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:1.0:1788483147.624172:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:2351:x1875360064070656:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788483147.624178:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788483147.624181:0:14332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 24 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.624204:0:14332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 24 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.624217:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:1.0:1788483147.624221:0:14332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.624235:0:14332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.624286:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.624308:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788483147.624330:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:2351:x1875360064070656:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 157us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483147.624336:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00010000:00010000:2.0:1788483147.625579:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a156 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ef3 expref: 23 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483147.625602:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14346:1875360072445184:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483147.625616:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a0a7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077ec2 expref: 22 pid: 14347 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483147.625625:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14346:1875360072445312:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483147.625651:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.625661:0:14346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.625679:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483147.625702:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788483147.628342:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a16b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 23 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.628376:0:14346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 22 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.628388:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:2.0:1788483147.628392:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788483147.628395:0:14346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781c00, rc 0) 00000100:00100000:2.0:1788483147.628613:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+22:14535:x1875360064070528:12345-192.168.201.6@tcp:101:bash.0 Request processed in 9060us (9395us total) trans 8589934617 rc 0/0 00000100:00100000:2.0:1788483147.628623:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 40 00000100:00100000:0.0:1788483147.636166:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483147.636368:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064071040 00000100:00100000:3.0:1788483147.636382:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064071040 00000100:00100000:3.0:1788483147.636463:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 41 00000100:00100000:3.0:1788483147.636476:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+22:14535:x1875360064071040:12345-192.168.201.6@tcp:36:bash.0 00010000:00010000:3.0:1788483147.636827:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.636848:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.638374:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788483147.638559:0:14345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000004:00010000:3.0:1788483147.638605:0:14345:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031016f70 reply state 0000000084643662 transno 8589934619 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483147.638617:0:14345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788483147.639056:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14535:x1875360064071040:12345-192.168.201.6@tcp:36:bash.0 Request processed in 2578us (2900us total) trans 8589934619 rc 0/0 00000100:00100000:3.0:1788483147.639066:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 41 00000020:00080000:3.0:1788483147.639074:0:14345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788483147.643686:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.643708:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.643715:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.643722:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe14800 already unused, calling callback (ffffffffc214d4f0) 00000100:00100000:0.0:1788483147.643725:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:1.0:1788483147.643728:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.643737:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.643759:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:1.0:1788483147.643762:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788483147.643769:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.643776:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a180 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483147.645597:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064071168 00000100:00100000:3.0:1788483147.645614:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064071168 00000100:00100000:2.0:1788483147.645846:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:2.0:1788483147.645870:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14535:x1875360064071168:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788483147.645898:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483147.645919:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a187 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f08 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.645990:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a187 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f08 expref: 25 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.646001:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a187 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f08 expref: 25 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.646031:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:2.0:1788483147.646033:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483147.646036:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780a00, rc 0) 00000100:00100000:2.0:1788483147.646106:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14535:x1875360064071168:12345-192.168.201.6@tcp:101:bash.0 Request processed in 240us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.646111:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 42 00000100:00100000:0.0:1788483147.654547:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.654640:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064071296 00000100:00100000:2.0:1788483147.654652:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064071296 00000100:00100000:2.0:1788483147.654722:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:2.0:1788483147.654735:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14535:x1875360064071296:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788483147.654760:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483147.654786:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a18e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f0f expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.654966:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.654979:0:16217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 26 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.654986:0:16217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.655022:0:16217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 26 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.655033:0:16217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 26 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483147.655061:0:16217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16217:1875360072445440:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483147.655217:0:16217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937dbe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788483147.657694:0:16217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16217:1875360072445440:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483147.657728:0:16217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483147.658014:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483147.658062:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064071424 00000100:00100000:3.0:1788483147.658071:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064071424 00010000:00010000:3.0:1788483147.658115:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 27 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483147.658160:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:3.0:1788483147.658172:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+27:2351:x1875360064071424:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483147.658388:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483147.658398:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 27 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.658413:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 27 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.658442:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781c00/0x42820277aad7a172 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f01 expref: 27 pid: 14346 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.658487:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:3.0:1788483147.658494:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.658505:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.658514:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.658546:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483147.658625:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+26:2351:x1875360064071424:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 454us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483147.658633:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00010000:00010000:2.0:1788483147.659670:0:16217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.659682:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483147.659735:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788483147.659739:0:16217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483147.659758:0:16217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.659788:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a18e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f0f expref: 26 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.659804:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f0f expref: 25 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.659812:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:2.0:1788483147.659815:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483147.659818:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780000, rc 0) 00000100:00100000:2.0:1788483147.659875:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14535:x1875360064071296:12345-192.168.201.6@tcp:101:bash.0 Request processed in 5143us (5341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.659890:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 43 00000100:00100000:0.0:1788483147.662439:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483147.662535:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064071680 00000100:00100000:3.0:1788483147.662546:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064071680 00000100:00100000:3.0:1788483147.662608:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:3.0:1788483147.662621:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14535:x1875360064071680:12345-192.168.201.6@tcp:103:bash.0 00010000:00010000:3.0:1788483147.662639:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788483147.662665:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780000/0x42820277aad7a195 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f0f expref: 25 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.662682:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780a00/0x42820277aad7a187 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f08 expref: 24 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.662689:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1200) 00010000:00010000:3.0:1788483147.662698:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483147.662760:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+23:14535:x1875360064071680:12345-192.168.201.6@tcp:103:bash.0 Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483147.662769:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 2 00000100:00100000:0.0:1788483147.664710:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.664782:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064071808 00000100:00100000:2.0:1788483147.664792:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064071808 00000100:00100000:2.0:1788483147.664840:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:2.0:1788483147.664850:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+23:14535:x1875360064071808:12345-192.168.201.6@tcp:58:bash.0 00010000:00010000:2.0:1788483147.664986:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.665004:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.665015:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483147.666584:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788483147.666751:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788483147.666835:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788483147.667324:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+23:14535:x1875360064071808:12345-192.168.201.6@tcp:58:bash.0 Request processed in 2470us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.667336:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 44 00000100:00100000:1.0:1788483147.669937:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483147.670018:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064071936 00000100:00100000:3.0:1788483147.670031:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064071936 00000100:00100000:3.0:1788483147.670100:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:3.0:1788483147.670112:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+23:14535:x1875360064071936:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:3.0:1788483147.670137:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483147.670161:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a1a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f16 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.670241:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.670283:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a1a3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f16 expref: 24 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.670317:0:14345:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.670333:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a1a3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f16 expref: 24 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.670349:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1400) 00010000:00010000:3.0:1788483147.670352:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483147.670357:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a1a3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f16 expref: 24 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.670365:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15200, rc 0) 00000100:00100000:3.0:1788483147.670442:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14535:x1875360064071936:12345-192.168.201.6@tcp:101:bash.0 Request processed in 331us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483147.670449:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 45 00000100:00100000:0.0:1788483147.700223:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072445696:0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.700352:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483147.700381:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072445952:0@lo:400:kworker.0 00000100:00100000:2.0:1788483147.700421:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483147.700449:0:3279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072445824:0@lo:400:kworker.0 00000100:00100000:2.0:1788483147.700475:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483147.700514:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072445696 00000100:00100000:2.0:1788483147.700524:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072445696 00000100:00100000:2.0:1788483147.700594:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072445824 00000100:00100000:2.0:1788483147.700598:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072445824 00000100:00100000:0.0:1788483147.700608:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3278:1875360072446208:0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.700636:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483147.700650:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483147.700660:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072445696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.700660:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788483147.700665:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb921644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072445568:0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.700692:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483147.700710:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875360072445696:12345-0@lo:400:kworker.0 Request processed in 52us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.700717:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788483147.700733:0:3278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072446080:0@lo:400:kworker.0 00000100:00100000:2.0:1788483147.700735:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483147.700741:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072445824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.700756:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483147.700768:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875360072445824:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.700774:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788483147.700797:0:3279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3279:1875360072445824:0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.700797:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3278:1875360072445696:0@lo:400:kworker.0 00000100:00100000:2.0:1788483147.700820:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072445952 00000100:00100000:2.0:1788483147.700823:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072445952 00000100:00080000:0.0:1788483147.700826:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788483147.700830:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483147.700846:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072446208 00000100:00100000:0.0:1788483147.700847:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072445568 00000100:00100000:2.0:1788483147.700849:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072446208 00000100:00100000:0.0:1788483147.700849:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072445568 00000100:00100000:2.0:1788483147.700865:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072446080 00000100:00100000:2.0:1788483147.700868:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072446080 00000100:00100000:2.0:1788483147.700883:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788483147.700889:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072445952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483147.700921:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875360072445952:12345-0@lo:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.700928:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788483147.700940:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788483147.700946:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875360072446208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483147.700978:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875360072446208:12345-0@lo:400:kworker.0 Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.700984:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788483147.700991:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788483147.700998:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3278:x1875360072445568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483147.701000:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788483147.701005:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072446080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788483147.701028:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875360072446080:12345-0@lo:400:kworker.0 Request processed in 23us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483147.701028:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a2d1d6-061f-4613-bc6f-7f9dfae33666+19:3278:x1875360072445568:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.701034:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788483147.701080:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875360072445952:0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.701095:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788483147.701193:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788483147.701211:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb921644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:34a2d1d6-061f-4613-bc6f-7f9dfae33666:3278:1875360072445568:0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.701222:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3278:1875360072446080:0@lo:400:kworker.0 00000100:00100000:0.0:1788483147.701230:0:3278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3278:1875360072446208:0@lo:400:kworker.0 00000100:00100000:1.0:1788483147.701316:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788483147.701326:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072446336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788483147.701362:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483147.702571:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072446336 00000100:00100000:0.0:1788483147.702581:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072446336 00000100:00100000:0.0:1788483147.702636:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788483147.702646:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072446336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788483147.702682:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788483147.702738:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072446336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483147.702745:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788483147.704740:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072446336:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788483147.826614:0:14377:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788483147.826642:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483147.826689:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788483147.826697:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788483147.828006:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec58700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14377:1875360072446464:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788483147.828560:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788483147.842376:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec58700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14377:1875360072446464:192.168.201.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788483147.847492:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483147.850072:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064072064 00000100:00100000:1.0:1788483147.850095:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064072064 00000100:00100000:1.0:1788483147.850597:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1788483147.850611:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14536:x1875360064072064:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788483147.850735:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14536:x1875360064072064:12345-192.168.201.6@tcp:900:lhsmtool_posix.0 Request processed in 126us (3258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483147.850744:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:3.0:1788483147.853306:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.853997:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064072192 00000100:00100000:2.0:1788483147.854011:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064072192 00000100:00100000:2.0:1788483147.854210:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:2.0:1788483147.854224:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14536:x1875360064072192:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788483147.854334:0:14347:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788483147.854506:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14536:x1875360064072192:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 285us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.854514:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 46 00000100:00100000:3.0:1788483147.859116:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.859282:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064072320 00000100:00100000:2.0:1788483147.859303:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064072320 00000100:00100000:2.0:1788483147.859418:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:2.0:1788483147.859430:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14536:x1875360064072320:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788483147.859522:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859541:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859556:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859747:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859766:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859776:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859804:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859810:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859814:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788483147.859855:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788483147.859858:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788483147.859873:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859881:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859962:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859969:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859987:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483147.859990:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.859996:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860005:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb923cf3600) 00010000:00010000:2.0:1788483147.860007:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483147.860010:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860014:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860026:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860029:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860033:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860036:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483147.860037:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860040:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860456:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9eb902ab1900) 00010000:00010000:2.0:1788483147.860460:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483147.860463:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860469:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860486:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860492:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860498:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860503:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483147.860507:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860513:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860527:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1400) 00010000:00010000:2.0:1788483147.860529:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483147.860608:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.860616:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483147.860721:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14536:x1875360064072320:12345-192.168.201.6@tcp:34:lhsmtool_posix.0 Request processed in 1289us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483147.860728:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 47 00000100:00100000:0.0:1788483147.870967:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483147.871068:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064072576 00000100:00100000:3.0:1788483147.871082:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064072576 00000100:00100000:3.0:1788483147.871165:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:3.0:1788483147.871188:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14536:x1875360064072576:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483147.871216:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483147.871242:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a1bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f1d expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871534:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871552:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871566:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483147.871579:0:16217:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788483147.871703:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871713:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871721:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871745:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93fe15000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483147.871750:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871758:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871773:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1400) 00010000:00010000:3.0:1788483147.871776:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788483147.871782:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.871788:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.872678:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a1bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f1d expref: 26 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.872691:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9eb923cf3600) 00010000:00010000:3.0:1788483147.872694:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788483147.872699:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a1bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f1d expref: 26 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.872709:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14800, rc 0) 00000100:00100000:3.0:1788483147.872952:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14536:x1875360064072576:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 1775us (2098us total) trans 8589934620 rc 301/301 00000100:00100000:3.0:1788483147.872962:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 48 00000100:00100000:0.0:1788483147.889641:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483147.889754:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064072704 00000100:00100000:1.0:1788483147.889768:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064072704 00000100:00100000:1.0:1788483147.889848:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:1.0:1788483147.889869:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14536:x1875360064072704:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788483147.889916:0:14346:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788483147.890050:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14536:x1875360064072704:12345-192.168.201.6@tcp:53:lhsmtool_posix.0 Request processed in 183us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483147.890058:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 49 00000100:00100000:0.0:1788483147.895147:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.896393:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064072960 00000100:00100000:2.0:1788483147.896417:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064072960 00000100:00100000:2.0:1788483147.896497:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:2.0:1788483147.896511:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+25:14536:x1875360064072960:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788483147.896540:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483147.896567:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f24 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788483147.901575:0:14347:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1788483147.901592:0:14347:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788483147.901651:0:14347:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788483147.903203:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.903226:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.903240:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.903563:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a1d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f24 expref: 28 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.903587:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f24 expref: 27 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.903613:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb902ab1900) 00010000:00010000:2.0:1788483147.903617:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788483147.903621:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f780c00, rc 0) 00000100:00100000:2.0:1788483147.904970:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+27:14536:x1875360064072960:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 8455us (9841us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788483147.904982:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 50 00000100:00100000:0.0:1788483147.935425:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.935667:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064073216 00000100:00100000:2.0:1788483147.935681:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064073216 00000100:00100000:2.0:1788483147.935761:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:2.0:1788483147.935774:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+27:14536:x1875360064073216:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788483147.935870:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483147.935907:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a1db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f24 expref: 27 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.935930:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb902ab1900) 00010000:00010000:2.0:1788483147.935943:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483147.935972:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.935987:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.935999:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936017:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936049:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936056:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936677:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936687:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936694:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936701:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483147.936706:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936715:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936725:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3c00) 00010000:00010000:2.0:1788483147.936728:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483147.936732:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936738:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a1e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936748:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936761:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936767:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936774:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483147.936777:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936784:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936803:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x14633275 (ffff9eb902ab1a00) 00010000:00010000:2.0:1788483147.936806:0:14346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483147.936809:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.936816:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a1f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x14633275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483147.936921:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+26:14536:x1875360064073216:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1149us (1518us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788483147.936929:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 51 00000100:00100000:0.0:1788483147.939970:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483147.940104:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064073344 00000100:00100000:3.0:1788483147.940142:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064073344 00000100:00100000:3.0:1788483147.940214:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:3.0:1788483147.940226:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+26:14536:x1875360064073344:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483147.940303:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483147.940332:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a1f7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f2b expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.940374:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.940388:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.940400:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.940515:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a1f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f2b expref: 28 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.940534:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15000/0x42820277aad7a1fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f2b expref: 27 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.940543:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:3.0:1788483147.940547:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788483147.940550:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe15000, rc 0) 00000100:00100000:3.0:1788483147.940605:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+27:14536:x1875360064073344:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 382us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483147.940612:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 52 00000100:00100000:0.0:1788483147.952105:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.952207:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064073600 00000100:00100000:2.0:1788483147.952221:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064073600 00000100:00100000:2.0:1788483147.952326:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:2.0:1788483147.952338:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+27:14536:x1875360064073600:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788483147.952459:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.952495:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483147.952509:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788483147.953049:0:14346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788483147.953063:0:14346:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465118813184ns, next at 466118809509ns, rc = 0 00000004:00010000:2.0:1788483147.953172:0:14346:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab806a24 reply state 0000000016b34e45 transno 8589934622 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483147.953194:0:14346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483147.953349:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+29:14536:x1875360064073600:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1012us (1258us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788483147.953357:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 53 00000100:00100000:0.0:1788483147.958557:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:1.0:1788483147.958655:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.958670:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.958697:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.958704:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f781000 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:1.0:1788483147.958710:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.958718:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.958739:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:1.0:1788483147.958742:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788483147.958747:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788483147.958754:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f781000/0x42820277aad7a205 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483147.959644:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064073728 00000100:00100000:3.0:1788483147.959667:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064073728 00000100:00100000:3.0:1788483147.959742:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:3.0:1788483147.959755:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+28:14536:x1875360064073728:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483147.959800:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483147.959823:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f32 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.959986:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 29 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.960001:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 29 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483147.960022:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:3.0:1788483147.960026:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788483147.960029:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93fe14800, rc 0) 00000100:00100000:3.0:1788483147.960105:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+29:14536:x1875360064073728:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 352us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483147.960113:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 54 00000100:00100000:1.0:1788483147.974668:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.976573:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064073856 00000100:00100000:2.0:1788483147.976591:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064073856 00000100:00100000:2.0:1788483147.976709:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:2.0:1788483147.976723:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2352:x1875360064073856:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788483147.977503:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788483147.977753:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2352:x1875360064073856:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 1029us (3097us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788483147.981705:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788483147.985077:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483147.987809:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064074112 00000100:00100000:2.0:1788483147.987832:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064074112 00000100:00100000:2.0:1788483147.987944:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:2.0:1788483147.987958:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+29:14536:x1875360064074112:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788483147.988346:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+30:14536:x1875360064074112:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 389us (3283us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788483147.988371:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:0.0:1788483148.001841:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483148.002606:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064074368 00000100:00100000:2.0:1788483148.002622:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064074368 00000100:00100000:2.0:1788483148.002704:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:2.0:1788483148.002716:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+30:14536:x1875360064074368:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788483148.002984:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+30:14536:x1875360064074368:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 269us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483148.002993:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 55 00000100:00100000:0.0:1788483148.009363:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483148.009610:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064074496 00000100:00100000:3.0:1788483148.009625:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064074496 00000100:00100000:3.0:1788483148.009696:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:3.0:1788483148.009709:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+30:14536:x1875360064074496:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483148.009736:0:16217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483148.009762:0:16217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a213 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f39 expref: -99 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.009909:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67200/0x42820277aad7a21a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.009926:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67200/0x42820277aad7a21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.009940:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67200/0x42820277aad7a21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788483148.009987:0:16217:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788483148.010008:0:16217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67200/0x42820277aad7a21a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.010040:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a213 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f39 expref: 32 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.010061:0:16217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67200/0x42820277aad7a21a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f39 expref: 31 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.010070:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:3.0:1788483148.010073:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788483148.010078:0:16217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67200, rc 0) 00000100:00100000:3.0:1788483148.010540:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+31:14536:x1875360064074496:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 832us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.010549:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 56 00000100:00100000:3.0:1788483148.016303:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483148.017729:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064074624 00000100:00100000:0.0:1788483148.017745:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064074624 00000100:00100000:0.0:1788483148.017839:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788483148.017860:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+6:2352:x1875360064074624:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788483148.017882:0:15030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483148.017913:0:15030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f40 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788483148.017947:0:15030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9a164c, blocks: 0x1 00010000:00010000:0.0:1788483148.017993:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788483148.017998:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483148.018011:0:15030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 7 pid: 15030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.018037:0:15030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 7 pid: 15030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.018053:0:15030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368400, rc 0) 00000100:00100000:0.0:1788483148.018143:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:2352:x1875360064074624:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 293us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483148.018151:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:0.0:1788483148.025383:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483148.027108:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064074880 00000100:00100000:2.0:1788483148.027127:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064074880 00000100:00100000:2.0:1788483148.027227:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:2.0:1788483148.027241:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+31:14536:x1875360064074880:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788483148.027454:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+31:14536:x1875360064074880:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 216us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483148.027462:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 57 00000100:00100000:1.0:1788483148.032137:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483148.032299:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064075008 00000100:00100000:3.0:1788483148.032311:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064075008 00000100:00100000:3.0:1788483148.032414:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:3.0:1788483148.032428:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+31:14536:x1875360064075008:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788483148.094962:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:0.0:1788483148.095055:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:0.0:1788483148.095066:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000004:00080000:0.0:1788483148.095075:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788483148.095645:0:3280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072446592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788483148.095738:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483148.096026:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072446592 00000100:00100000:2.0:1788483148.096037:0:15620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072446592 00000100:00100000:2.0:1788483148.096100:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788483148.096173:0:15620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875360072446592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788483148.098594:0:15620:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788483148.098602:0:15620:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788483148.098604:0:15620:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788483148.098607:0:15620:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788483148 -> 1788483148 00002000:00010000:2.0:1788483148.098610:0:15620:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788483148.098765:0:15620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875360072446592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2651us (3023us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788483148.098800:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788483148.099074:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+13:14536:x1875360064075008:12345-192.168.201.6@tcp:44:lhsmtool_posix.0 Request processed in 66645us (66962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.099084:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 58 00000100:00100000:3.0:1788483148.102552:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483148.102758:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064075136 00000100:00100000:0.0:1788483148.102772:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064075136 00000100:00100000:0.0:1788483148.102917:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:0.0:1788483148.102931:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:2351:x1875360064075136:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788483148.103091:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:2351:x1875360064075136:12345-192.168.201.6@tcp:16:lhsmtool_posix.0 Request processed in 163us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483148.103100:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000004:00080000:1.0:1788483148.104999:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9eb936e13100/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788483148.105015:0:3280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3280:1875360072446592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788483148.107112:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483148.107387:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064075392 00000100:00100000:2.0:1788483148.107401:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064075392 00000100:00100000:2.0:1788483148.107489:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 59 00000100:00100000:2.0:1788483148.107503:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+13:14536:x1875360064075392:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788483148.107581:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788483148.107617:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67200/0x42820277aad7a21a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f39 expref: 13 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.107642:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:2.0:1788483148.107648:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788483148.107690:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.107707:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.107719:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788483148.108148:0:14346:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b94a8c3 reply state 000000003f153c1f transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483148.108226:0:14346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788483148.108527:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+14:14536:x1875360064075392:12345-192.168.201.6@tcp:36:lhsmtool_posix.0 Request processed in 1026us (1423us total) trans 8589934624 rc 0/0 00000100:00100000:2.0:1788483148.108536:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 59 00010000:00010000:0.0:1788483148.114741:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.114781:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.114799:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.114805:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:0.0:1788483148.114811:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.114820:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.114839:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:0.0:1788483148.114842:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788483148.114853:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.114860:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a228 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483148.117612:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483148.118198:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064075520 00000100:00100000:3.0:1788483148.118213:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064075520 00000100:00100000:3.0:1788483148.118779:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788483148.118801:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:14536:x1875360064075520:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788483148.118825:0:15028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788483148.118996:0:15028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f47 expref: -99 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.119038:0:15028:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 8 pid: 15030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.119048:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483148.119053:0:15028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788483148.119060:0:15028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 8 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.119106:0:15028:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 8 pid: 15030 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.119193:0:15028:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 8 pid: 15030 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483148.119231:0:15028:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93718c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15028:1875360072446720:192.168.201.6@tcp:104: 00000100:00100000:3.0:1788483148.119696:0:15028:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9217dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788483148.125425:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483148.125609:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064075648 00000100:00100000:0.0:1788483148.125622:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064075648 00010000:00010000:0.0:1788483148.125673:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 9 pid: 15030 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483148.125726:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:0.0:1788483148.125739:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:2351:x1875360064075648:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788483148.125780:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788483148.125810:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 9 pid: 15030 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.125826:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 9 pid: 15030 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.125869:0:14330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483148.125875:0:14330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788483148.125885:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 9 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.125896:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 9 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.125947:0:14330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 9 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483148.125965:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb92ec5bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14330:1875360072446848:192.168.201.6@tcp:105: 00000100:00100000:0.0:1788483148.126083:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93b0346c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788483148.126514:0:15028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dede475/0x42820277aad7a221 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f40 expref: 9 pid: 15030 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483148.126534:0:15028:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93718c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15028:1875360072446720:192.168.201.6@tcp:104: 00010000:00010000:3.0:1788483148.126570:0:15028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 8 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.126582:0:15028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb910c67c00, rc 0) 00000100:00100000:3.0:1788483148.126676:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+8:14536:x1875360064075520:12345-192.168.201.6@tcp:101:lhsmtool_posix.0 Request processed in 7886us (9078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.126684:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:0.0:1788483148.130530:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb92ec5bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14330:1875360072446848:192.168.201.6@tcp:105: 00010000:00010000:0.0:1788483148.130563:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788483148.130666:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:2351:x1875360064075648:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 4930us (5266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483148.130678:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:2.0:1788483148.132819:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483148.133796:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064075776 00000100:00100000:3.0:1788483148.133811:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064075776 00000100:00100000:3.0:1788483148.133978:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:3.0:1788483148.133992:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:2351:x1875360064075776:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788483148.134677:0:15030:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788483148.134682:0:15030:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788483147 00002000:00010000:3.0:1788483148.134685:0:15030:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788483145 00002000:00010000:3.0:1788483148.134688:0:15030:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788483148 -> 1788483147 00002000:00010000:3.0:1788483148.134691:0:15030:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788483148.134766:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+8:2351:x1875360064075776:12345-192.168.201.6@tcp:2:lhsmtool_posix.0 Request processed in 777us (1958us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788483148.134787:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:0.0:1788483148.137824:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483148.137927:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064075904 00000100:00100000:2.0:1788483148.137940:0:15620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064075904 00000100:00100000:2.0:1788483148.137998:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:2.0:1788483148.138008:0:15620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb92ec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+8:2352:x1875360064075904:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788483148.138063:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.138090:0:15620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 8 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.138101:0:15620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483148.138107:0:15620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788483148.138121:0:15620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.138164:0:15620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 8 pid: 15028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.138189:0:15620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 8 pid: 15028 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483148.138207:0:15620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15620:1875360072446976:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483148.138822:0:15620:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb908551cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483148.144548:0:15620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15620:1875360072446976:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483148.144588:0:15620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788483148.144727:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483148.144831:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064076032 00000100:00100000:3.0:1788483148.144842:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064076032 00010000:00010000:3.0:1788483148.144947:0:14331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 9 pid: 15028 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483148.144992:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:3.0:1788483148.145005:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+9:2352:x1875360064076032:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483148.145023:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483148.145051:0:14331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 9 pid: 15028 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.145064:0:14331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 9 pid: 15028 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.145096:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a31e1153/0x42820277aad7a22f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f47 expref: 9 pid: 15028 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.145490:0:14331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483148.145496:0:14331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788483148.145503:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.145515:0:14331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.145564:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483148.145624:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+8:2352:x1875360064076032:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 621us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.145633:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00010000:00010000:2.0:1788483148.145737:0:15620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.145748:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.145777:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.145785:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.145794:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.145801:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780c00 already unused, calling callback (ffffffffc1743230) 00010000:00010000:2.0:1788483148.145806:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.145815:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.145828:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.145914:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cb46fb/0x42820277aad7a236 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483148.145973:0:15620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb92ec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:2352:x1875360064075904:12345-192.168.201.6@tcp:1:lhsmtool_posix.0 Request processed in 7965us (8162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483148.145982:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:0.0:1788483148.158977:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483148.159165:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064076288 00000100:00100000:2.0:1788483148.159190:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064076288 00000100:00100000:2.0:1788483148.159314:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 60 00000100:00100000:2.0:1788483148.159327:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+13:14536:x1875360064076288:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788483148.159449:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.159470:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.159484:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.159818:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.159830:0:14347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 14 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.159838:0:14347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.160393:0:14347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 14 pid: 16217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.161029:0:14347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 14 pid: 16217 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483148.161049:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14347:1875360072447104:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788483148.161195:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb908551cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788483148.168668:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483148.169149:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14347:1875360072447104:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788483148.169193:0:14347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483148.170036:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064076416 00000100:00100000:3.0:1788483148.170047:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064076416 00010000:00010000:3.0:1788483148.170097:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 15 pid: 16217 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483148.170223:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788483148.170234:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+15:2351:x1875360064076416:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788483148.170311:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788483148.170321:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 15 pid: 16217 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.170336:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 15 pid: 16217 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.170364:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe14800/0x42820277aad7a20c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f32 expref: 15 pid: 16217 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.170385:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:3.0:1788483148.170391:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.170403:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.170431:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.170460:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788483148.170527:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+14:2351:x1875360064076416:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 295us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.170535:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00010000:00010000:2.0:1788483148.170989:0:14347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.170998:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788483148.171266:0:14347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788483148.171443:0:14347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000001:00080000:2.0:1788483148.171489:0:14347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788483148.171576:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14347:1875360072447232:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788483148.171846:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483148.171903:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb937169540 going to sleep for 11 seconds 00000100:00100000:2.0:1788483148.171958:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072447232 00000100:00100000:2.0:1788483148.171966:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072447232 00000100:00100000:2.0:1788483148.172007:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483148.172014:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14347:x1875360072447232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788483148.172112:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14347:x1875360072447232:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483148.172119:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788483148.172160:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14347:1875360072447232:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788483148.173169:0:14347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000100:00100000:2.0:1788483148.173287:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14347:1875360072447360:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788483148.173335:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788483148.173358:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb93a067c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788483148.173377:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072447360 00000100:00100000:2.0:1788483148.173383:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072447360 00000100:00100000:2.0:1788483148.173419:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483148.173427:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14347:x1875360072447360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788483148.173594:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb936e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14347:x1875360072447360:12345-0@lo:1000:mdt00_002.0 Request processed in 166us (257us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788483148.173601:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788483148.173654:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e13800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14347:1875360072447360:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788483148.173686:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173695:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173702:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173708:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483148.173712:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173737:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173836:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:2.0:1788483148.173839:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483148.173844:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173851:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a244 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173881:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173886:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173892:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173896:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780200 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483148.173899:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173904:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173910:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1400) 00010000:00010000:2.0:1788483148.173912:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788483148.173919:0:14347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a1a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f16 expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173941:0:14347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a1a3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f16 expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173949:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a1a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f16 expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.173999:0:14347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93fe15200/0x42820277aad7a1a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f16 expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483148.174011:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb936e11500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14347:1875360072447488:192.168.201.6@tcp:105: 00000100:00100000:2.0:1788483148.176739:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9eb9030699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788483148.182686:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb936e11500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14347:1875360072447488:192.168.201.6@tcp:105: 00010000:00010000:2.0:1788483148.182716:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.182737:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780200/0x42820277aad7a19c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.182935:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.182948:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.182959:0:14347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.182969:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.182988:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.182994:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183000:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780600 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:2.0:1788483148.183004:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183011:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183025:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1400) 00010000:00010000:2.0:1788483148.183029:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788483148.183033:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183040:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780600/0x42820277aad7a24b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183052:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183059:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183064:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183074:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780c00 already unused, calling callback (ffffffffc214d4f0) 00000100:00100000:0.0:1788483148.183078:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:2.0:1788483148.183090:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183098:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183106:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1400) 00010000:00010000:2.0:1788483148.183124:0:14347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788483148.183127:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.183133:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780c00/0x42820277aad7a23d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788483148.183633:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14536:x1875360064076288:12345-192.168.201.6@tcp:57:lhsmtool_posix.0 Request processed in 24304us (24666us total) trans 8589934629 rc 0/0 00000100:00100000:2.0:1788483148.183647:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 60 00000020:00080000:2.0:1788483148.183654:0:14347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788483148.184246:0:14377:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788483148.184324:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788483148.184360:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788483148.184366:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788483148.184513:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064076544 00000100:00100000:3.0:1788483148.184528:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064076544 00000100:00100000:3.0:1788483148.184646:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:3.0:1788483148.184669:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb921647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14535:x1875360064076544:12345-192.168.201.6@tcp:49:bash.0 00000100:00100000:3.0:1788483148.184830:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb921647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14535:x1875360064076544:12345-192.168.201.6@tcp:49:bash.0 Request processed in 164us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.184838:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788483148.191954:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483148.192003:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483148.192025:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064076800 00000100:00100000:1.0:1788483148.192043:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064076800 00000100:00100000:2.0:1788483148.192096:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064076928 00000100:00100000:2.0:1788483148.192107:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064076928 00000100:00100000:2.0:1788483148.192191:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:2.0:1788483148.192202:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+7:14535:x1875360064076928:12345-192.168.201.6@tcp:101:bash.0 00010000:00010000:2.0:1788483148.192221:0:15031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788483148.192243:0:15031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006323371c/0x42820277aad7a252 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f4e expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788483148.192304:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9a164b, atime: 0x6a9a1649, ctime: 0x6a9a164b, blocks: 0x1 00010000:00010000:2.0:1788483148.192326:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788483148.192331:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788483148.192357:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006323371c/0x42820277aad7a252 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f4e expref: 8 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.192375:0:15031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006323371c/0x42820277aad7a252 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f4e expref: 8 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.192388:0:15031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb93f781000, rc 0) 00000100:00100000:2.0:1788483148.192444:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+8:14535:x1875360064076928:12345-192.168.201.6@tcp:101:bash.0 Request processed in 244us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483148.192452:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788483148.193010:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 13 00000100:00100000:1.0:1788483148.193027:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb920897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+17:14536:x1875360064076800:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788483148.194823:0:14349:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788483148.198677:0:14349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00010000:00010000:2.0:1788483148.198784:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.198808:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.198822:0:14349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.198832:0:14349:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.198839:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.198859:0:14349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788483148.198899:0:14349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788483148.198983:0:14334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788483148.198995:0:14334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.199003:0:14334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb93f780400 already unused, calling callback (ffffffffc1743230) 00010000:00010000:0.0:1788483148.199007:0:14334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.199014:0:14334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.199029:0:14334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9eb9231eb600) 00010000:00010000:0.0:1788483148.199031:0:14334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788483148.199034:0:14334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.199038:0:14334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb93f780400/0x42820277aad7a259 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.199054:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788483148.199074:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483148.199077:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb920897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+19:14536:x1875360064076800:12345-192.168.201.6@tcp:35:lhsmtool_posix.0 Request processed in 6045us (7122us total) trans 8589934631 rc 0/0 00010000:00010000:0.0:1788483148.199077:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788483148.199094:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 13 00000020:00080000:2.0:1788483148.199102:0:14349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788483148.205031:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483148.205204:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064077184 00000100:00100000:3.0:1788483148.205218:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064077184 00000100:00100000:3.0:1788483148.205598:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 14 00000100:00100000:3.0:1788483148.205613:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+19:14535:x1875360064077184:12345-192.168.201.6@tcp:35:bash.0 00000001:00080000:2.0:1788483148.208650:0:14348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000001:00080000:2.0:1788483148.208968:0:14348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934633 00000100:00100000:2.0:1788483148.209960:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+22:14535:x1875360064077184:12345-192.168.201.6@tcp:35:bash.0 Request processed in 4341us (4932us total) trans 8589934634 rc 0/0 00000100:00100000:2.0:1788483148.209976:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 14 00000020:00080000:2.0:1788483148.209983:0:14348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788483148.340207:0:15618:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788483148.348780:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483148.348959:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064077440 00000100:00100000:0.0:1788483148.348974:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064077440 00000100:00100000:0.0:1788483148.349051:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:0.0:1788483148.349064:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+22:14546:x1875360064077440:12345-192.168.201.6@tcp:101:lfs.0 00010000:00010000:0.0:1788483148.349099:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788483148.349126:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a260 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2ebd0efe7077f55 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788483148.349609:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788483148.349802:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a260 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f55 expref: 24 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.349819:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9eb923cf3000) 00010000:00010000:0.0:1788483148.349822:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788483148.349828:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb907368000/0x42820277aad7a260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.6@tcp remote: 0xd2ebd0efe7077f55 expref: 24 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788483148.349944:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9eb907368000, rc 0) 00000100:00100000:0.0:1788483148.350074:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+23:14546:x1875360064077440:12345-192.168.201.6@tcp:101:lfs.0 Request processed in 1012us (1309us total) trans 8589934635 rc 301/301 00000100:00100000:0.0:1788483148.350082:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 61 00000100:00100000:1.0:1788483148.353908:0:3270:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788483148.353987:0:16217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064077568 00000100:00100000:3.0:1788483148.354000:0:16217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064077568 00000100:00100000:3.0:1788483148.354123:0:16217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:3.0:1788483148.354136:0:16217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+23:14546:x1875360064077568:12345-192.168.201.6@tcp:34:lfs.0 00010000:00010000:3.0:1788483148.354494:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354514:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354543:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354562:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354570:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354577:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354907:0:16217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354917:0:16217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354925:0:16217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788483148.354972:0:16217:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354986:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354992:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.354999:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355016:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67c00 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483148.355022:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355030:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355045:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9eb923cf3c00) 00010000:00010000:3.0:1788483148.355048:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483148.355053:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355059:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67c00/0x42820277aad7a26e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355072:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355079:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355085:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355089:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67800 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483148.355092:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355098:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355125:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9eb9231eb100) 00010000:00010000:3.0:1788483148.355127:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483148.355131:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355137:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67800/0x42820277aad7a275 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355163:0:16217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355178:0:16217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355184:0:16217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355189:0:16217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9eb910c67400 already unused, calling callback (ffffffffc214d4f0) 00010000:00010000:3.0:1788483148.355193:0:16217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355198:0:16217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355205:0:16217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9eb902ab1400) 00010000:00010000:3.0:1788483148.355207:0:16217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788483148.355210:0:16217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788483148.355215:0:16217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9eb910c67400/0x42820277aad7a27c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788483148.355719:0:16217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+23:14546:x1875360064077568:12345-192.168.201.6@tcp:34:lfs.0 Request processed in 1582us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.355728:0:16217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 62 00000100:00100000:1.0:1788483148.358568:0:3272:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788483148.358672:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064077824 00000100:00100000:2.0:1788483148.358685:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064077824 00000100:00100000:2.0:1788483148.358785:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:2.0:1788483148.358799:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+23:14546:x1875360064077824:12345-192.168.201.6@tcp:35:lfs.0 00000100:00100000:2.0:1788483148.359943:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:14546:x1875360064077824:12345-192.168.201.6@tcp:35:lfs.0 Request processed in 1142us (1380us total) trans 8589934636 rc 0/0 00000100:00100000:2.0:1788483148.359955:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788483148.763026:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483148.763077:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483148.763089:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064077952 00000100:00100000:0.0:1788483148.763103:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064077952 00000100:00100000:1.0:1788483148.763121:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483148.763174:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483148.763175:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:0.0:1788483148.763189:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93f253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:2353:x1875360064077952:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483148.763194:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483148.763229:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788483148.763387:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93f253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a73dd3dc-49a8-4977-a14c-11d5aaad0a61+13:2353:x1875360064077952:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 200us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483148.763412:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:3.0:1788483148.763423:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064078208 00000100:00100000:3.0:1788483148.763428:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064078208 00000100:00100000:3.0:1788483148.763467:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064078720 00000100:00100000:3.0:1788483148.763470:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064078720 00000100:00100000:0.0:1788483148.763475:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064078464 00000100:00100000:0.0:1788483148.763478:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064078464 00000100:00100000:3.0:1788483148.763497:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064078336 00000100:00100000:3.0:1788483148.763500:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064078336 00000100:00100000:0.0:1788483148.763508:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064078080 00000100:00100000:0.0:1788483148.763511:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064078080 00000100:00100000:3.0:1788483148.763528:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:0.0:1788483148.763529:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:3.0:1788483148.763536:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+8:2353:x1875360064078208:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788483148.763536:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:2353:x1875360064078464:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:2.0:1788483148.763613:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 17 00000100:00100000:2.0:1788483148.763624:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49d72f1d-b874-4119-991a-de07c355679e+5:2353:x1875360064078720:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483148.767998:0:3271:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788483148.768682:0:15030:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788483148.768697:0:15030:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788483148.769618:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+8:2353:x1875360064078208:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 6075us (6533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.769634:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:3.0:1788483148.769668:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360064078592 00000100:00100000:3.0:1788483148.769680:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360064078592 00000100:00100000:1.0:1788483148.769997:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788483148.770013:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:2353:x1875360064078080:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483148.770090:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+24:2353:x1875360064078080:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 82us (6893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483148.770098:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788483148.770140:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00100000:1.0:1788483148.770150:0:15620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2353:x1875360064078336:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788483148.770212:0:15620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f2cdc27-59e6-4887-b2f8-9564a19cdd8d+5:2353:x1875360064078336:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 64us (6993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788483148.770298:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 18 00000100:00080000:1.0:1788483148.770337:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788483148.770343:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788483148.770364:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788483148.770549:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788483148.770560:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93a142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49d72f1d-b874-4119-991a-de07c355679e+5:2353:x1875360064078592:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788483148.770606:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49d72f1d-b874-4119-991a-de07c355679e+5:2353:x1875360064078592:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 49us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788483148.770613:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:0.0:1788483148.771414:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49d72f1d-b874-4119-991a-de07c355679e+6:2353:x1875360064078464:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 7873us (8286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483148.771425:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 29 00000100:00100000:2.0:1788483148.773868:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93a140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49d72f1d-b874-4119-991a-de07c355679e+5:2353:x1875360064078720:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 10232us (10688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788483148.773886:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 17 00000001:00080000:3.0:1788483149.306297:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1788483149.306319:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:3.0:1788483149.306326:0:6686:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00010000:00010000:2.0:1788483149.364693:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788483149.776895:0:16612:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1788483150.258488:0:3277:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9eb93a142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072447616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788483150.258585:0:3277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788483150.258713:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875360072447616 00000100:00100000:0.0:1788483150.258721:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875360072447616 00000100:00100000:0.0:1788483150.258787:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788483150.258799:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9eb93718c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072447616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788483150.258837:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788483150.258911:0:14341:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788483150.262415:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9eb93718c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875360072447616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3607us (3819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788483150.262428:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788483150.274812:0:3277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788483150.274826:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9eb936e13100, transno 8589934595 00000004:00080000:3.0:1788483150.274882:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788483150.274924:0:3277:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9eb93a142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3277:1875360072447616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788483150.386496:0:14334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29902 lines, 29902 kept, 0 dropped, 0 bad.